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BY 
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Asymptotic  behavior  of  normed  weighted  sums  of  the  form 

n 

W  =  Z  a,  (X,  -Y,  )/b  is  studied.   Central  limit  theorems  as  well  as 
n   ,  ,  k  k  k   n 
k=1 

strong  and  weak  laws  of  large  numbers  are  obtained. 

Firstly,  we  establish  a  generalized  central  limit  theorem 

d 

W  ->•  N(0,1)  assuming  the  {x,  X  ,  n  >^  1  }  are  independent,  identically 

2 
distributed  with  EX  =  0,  EX  =  «>.   The  truncated  second  moment  is 

assumed  to  be  slowly  varying  at  infinity.   Then,  via  a 

transformation,  we  obtain  a  similar  result  where  the  condition  EX  =  0 

is  removed.   The  norming  sequence  (b  ,  n  >^  1 }  is  defined  in  terms  of 

the  common  distribution,  and  conditions  which  elicit  an  explicit 

asymptotic  representation  for  {b  ,  b  >_  1  }  are  found. 

Several  generalized  strong  laws  of  large  numbers  (W  ^  0  almost 

surely)  are  proved.   In  some  of  them,  the  random  variables 


Iv 


Ix  ,  n  >  1  I  are  stochastically  dominated  by  a  random  variable  X, 
'  n    - 

while  in  others  the  random  variables  {x  ,  n  >^  1 1  are  independent, 

identically  distributed.   Two  theorems  are  proved  showing  that  the 

assumption  of  independence  is,  in  general,  not  always  needed  to 

obtain  a  strong  law.   More  specifically,  their  hypotheses  involve 

both  the  behavior  of  the  tail  of  the  (marginal)  distributions  of  the 

{x  ,  n  >  1  I  and  the  growth  behavior  of  the  constants  b  /a  .   As 
'  n    -  '  n  n 

special  cases,  both  old  and  new  results  are  obtained.  Moreover,  for 
independent,  identically  distributed  {x,  X  ,  n  >_  1 } ,  a  strong  law  is 
established  under  the  assumption  of  regular  variation  of  the  tail 
p{|x|  >  x}  of  common  distribution  function. 

The  famous  Petersburg  paradox  is  also  examined  in  more  general 

n 

terms.   It  is  shown  that  P{lim  Z  a  X  /b  =  c}  =  0  for  any  sequence 

n->-o>  k  =  l 

lb  ,  n  >  1 }  and  finite  nonzero  constant  c  whenever  the  random 

^  n    -     ' 

variables  (x,  X  ,  n  ^  1  }  Sire   independent,  identically  distributed 

with  E|x|  =  "  and  |a  |  +. 

n  p 

Finally,  a  generalized  weak  law  of  large  numbers  (W  ■*   0)  is 
obtained.  Using  this  theorem  we  are  able  to  show  that  the  modified 
Petersburg  game  does  indeed  have  a  solution  in  the  "classical"  or 
"weak"  sense,  i.e.,  there  exists  a  sequence  {b  ,  n  >^  1  }  such  that 

n        P 

E  a,  X,  /b  ^  c,  where  the  requirements  placed  on  Ix,  X  ,  n  >  1 }  and  c 
,  ,kkn  'n-' 

k  =  l 

are  as  before. 

Throughout,  we  present  examples  that  illustrate  our  results  and 
compare  them  with  others  from  here  and  elsewhere. 


CHAPTER  ONE 
INTRODUCTION 


This  dissertation  will  explore  three  major  modes  of  convergence 
studied  in  probability  theory.   We  will  investigate  both  the  weak  and 
strong  limiting  behavior  of  a  normed  sum  of  weighted  random 
variables.   Such  sequences  of  normed  sums  are  expressed  in  the  form 


^^^^—^ .  n  >  1.  (1) 

n 


While  the  sequences  (a  ,  n  _>  1  }  and  {b  ,  n  >^  1  |  will  always  be 
numerical,  the  sequence  {x  ,  n  >_  1  }  will  consist  of  random  variables 
which  may  or  may  not  be  independent  or  even  identically 
distributed.   The  sequence  {y  ,  n  >^  1 }  will  take  on  many  different 
forms,  ranging  from  conditional  expectations  to  all  zeros. 

Chapter  Two  will  examine  when  (1)  converges  in  distribution  to  a 
standard  normal  random  variable.   This  is  commonly  referred  to  as  a 
central  limit  theorem  (CLT).   A  sequence  of  random  variables,  say  Z  , 
converges  in  distribution  to  a  standard  normal  random  variable  if 


^        ■  1.2, 


P{Z  <  z}  >  /   -^exp{-  ^t^}dt,  -"  <  z  < 

-00  /2tt 


The  case  when  the  random  variables  {x  ,  n  _>  1  }  are  independent 

with  finite  second  moment  has  been  thoroughly  investigated  (see 

Theorem  2.1).  The  topic  of  interest  in  Chapter  Two  is  whether  this 

limiting  behavior  still  prevails  when  the  second  moment  is 

infinite.  We  will  only  consider  the  situation  in  which  the  random 

variables  are  independent,  identically  distributed  (i.i.d.).  The 

first  major  result  will  establish  a  CLT  for  mean  zero  random 

variables.   In  contrast  to  the  case  when  the  second  moment  is  finite 

where  the  norming  constants  are  universal  (up  to  a  multiplicative 

constant),  the  norming  constants  {b  ,  n  >_  1 }  when  the  second  moment 

is  infinite  are  not  universal  but,  rather,  depend  on  the  common 

distribution  of  the  (x  ,  n  >  l}.  Then  by  studying  the  shifted 

sequence  of  random  variables,  Y  =  X  -EX  ,  n  >  1 ,  we  will  obtain  a 
^  n    n   n    - 

CLT  for  random  variables  with  arbitrary  first  moment  and  infinite 

second  moment . 

Strong  laws  of  large  numbers  (SLLN)  are  investigated  in  Chapter 

Three.  The  sequence  in  (1)  is  said  to  obey  the  strong  law  of  large 

n 

numbers  if  Z  a,  (X, -7,  )/b  ->  0  almost  surely  (a.s.),  that  is, 

,  ,  k  k  k   n 

k=1 


P|li 


^  v\-\^ 


im 


k=1 


b 
n->-«>       n 


This  chapter  contains  many  generalizations  of  the  classical 

n 
Kolmogorov  SLLN  (  I   X  /n  ■*   0  a.s.  whenever  {x  ,  n  ^  1  }  are  i.i.d. 

k  =  1  "  " 

with  mean  0).  Throughout,  we  will  extend  and  generalize  previous 

results  thereby  obtaining  them  as  special  cases  or  corollaries  of  our 


work.  See  Stout  (1974,  Chapter  4)  for  an  excellent  survey  of  known 

results  on  the  SLLN  problem  for  weighted  sums  of  random  variables. 

Mathematicians  have,  over  the  centuries,  tried  to  understand  the 

Petersburg  paradox.  Given  a  game  with  X^^  winnings  at  the  k   stage, 

it  was  asked  if  the  game  could  be  made  "fair"  in  the  sense  that  there 

n 

is  some  entrance  fee,  b  -b,  ,,  k  >  2,  such  that  E  X  /b  -'■I  a.s. 

k  k-1    -  ,  ,  k  n 

k  =  l 

This  is  relatively  easy  when  (x,  X  ,  n  _>  1  }  are  i.i.d.  with 
e|x|  <  ",  but  is  a  source  of  confusion  when  e|x|  =  ".  This  problem, 
when  the  random  variables  are  not  integrable,  is  called  the 
Petersburg  paradox. 

Placing  mild  restrictions  on  the  sequence  {a  ,  n  >_  1  } ,  we  will 
prove  that 


E  a,  X, 

1^  =  1 
P{lim  ^^—-r =  c}  =  0, 

D 

n-*"     n 


for  every  sequence  (b  ,  n  _>  1  I  snd  every  finite  nonzero  constant  c 

provided  that  the  random  variables  {x,  X  ,  n  >   ^}   are  i.i.d.  with 

e|x|  =  ".   This  result  generalizes  one  of  Chow  and  Robbins  (1961) 

wherein  a^  1.  For  a  detailed  discussion  of  this  paradox,  see 

Feller  (1968,  p.  251-253).   Feller,  however,  does  produce  a  sequence 

n      P 

lb  ,  n  >  1  1  such  that  E  X, /b  ^1  for  a  specific  sequence  of  i.i.d. 
'  n    -  '  .    k  n 

random  variables  with  e|x|  =  =°. 

There  is  also  the  question  as  to  whether  a  generalized  law  of 

2 
the  iterated  logarithm  can  hold  when  EX  =  <»,  i.e., 


P{lim  sup  ^^-^^ =  1  }  =  1 

n->-«>       n 


See  Rosalsky  (1981)  for  some  results  of  this  type. 

In  the  final  chapter,  we  consider  the  weak  law  of  large  numbers 

(WLLN) .   The  normed  sum  (1)  is  said  to  obey  the  weak  law  of  large 

n  P 

numbers  if  Z  a,  (X  -Y,  )/b  ->   0,  that  is, 

,  ,  k  k  k   n 

k  =  1 


I   a,  (X,  -Y,  ) 

^{\       — ^ 1  >  e}  =  0(1)  for^  all  e  >  0, 

n 


Clearly,  if  a  SLLN  holds,  then  a  WLLN  also  holds  for  the  same 

sequences.  Hence  Chapter  Three  also  establishes  many  weak  laws.   In 

view  of  a  very  general  result  known  as  the  Degenerate  Convergence 

Criterion  (see,  e.g..  Chow  and  Teicher,  1978,  p.  329),  we  acknowledge 

the  fact  that  most  work  on  the  WLLN  for  independent  {x  ,  n  ^  1 }  has 

already  been  done. 

Research  in  the  central  limit  theorem  and  laws  of  large  numbers 

date  back  to  the  1 8th  century.  The  very  first  SLLN  was  proved  in 

1909  by  Emile  Borel,  while  the  WLLN  dates  back  much  earlier.  A  WLLN 

for  i.i.d.  random  variables  with  a  finite  second  moment  was 

established  by  Jacob  Bernoulli  and  published  posthumously  by  his 

nephew  Nicholas  in  1713-   By  a  simple  application  of  Chebyshev's 

n      P 
inequality  it  was  shown  that  Z  ^i.^'^  "*  ^  when  JX,  X  ,  n  _>  1  } 

k  =  l  *"         2      " 
are  i.i.d.  mean  zero  random  variable  with  EX  <  <».  Many  famous 

mathematicians  have  played  a  prominent  role  in  the  evolution  of  the 


CLT.  For  a  detailed  history  of  the  development  of  these  and  related 
concepts,  see  Feller  (1945)  and  Le  Cam  (1986).   Also,  for  an 
excellent  survey  of  known  results,  see  Petrov  (1975). 

Some  remarks  about  notation  are  in  order.  Throughout,  the 
symbol  C  will  denote  a  generic  constant  (0  <  C  <  =»)  which  is  not 
necessarily  the  same  one  in  each  appearance.  Also,  in  order  to  avoid 
minor  complications,  it  proves  convenient  to  define 
log  X  =  log  max(e,x},  x  >  0,  where  log  t  denotes  the  natural 
logarithm.  Finally,  for  x  >^  0 ,  log  x  will  be  used  to  denote 
log  log  x. 


CHAPTER  TWO 
GENERALIZED  CENTRAL  LIMIT  THEOREMS 


2.1   Introduction 


The  question  as  to  whether  a  sequence  of  random  variables  obeys 
a  CLT  has  a  long  and  rich  history.   Firstly,  in  the  1700s,  there  was 
DeMoivre  and  Laplace  discovering  a  primitive  version  of  the  CLT  for  a 
sequence  of  Bernoulli  random  variables.  Two  hundred  years  later,  in 
the  1930s,  Llndeberg,  L6vy,  and  Feller  established  what  we  now 
generally  refer  to  as  the  CLT.   This  famous  result,  which  we  will  now 
state  as  Theorem  2.1,  is  known  as  the  Lindeberg-Feller  theorem. 


Theorem  2.1  (Chow  and  Teicher,  1978,  p.  291).   If  (x  ,  n  >  1 }  are 

2 

independent  random  variables  with  EX  =0,  Var(X  )  =  a  ,  n  >  1, 

n          n     n  — 


satisfying 


I   EX^I(|X|^|  >  eS|^)  =  o(s^)  (1) 

k=1 


2    "   2 
for  all  e  >  0,  where  s  =  E  o,  ,  n  >  1  ,  then 

"   k  =  1  '^    - 


n 
T.   X, 


k-1  ^   '^ 

^^ ^  N(0,1).  (2) 

s 
n 


Conversely,  if  (2)  holds  and  o  =  o(s  ),  s  -»•  <»  then  (1)  obtains, 

n      n    n 


Proof.  See  Chow  and  Telcher  (1978,  p.  290-293 ).D 

2 

Clearly,  this  theorem  is  not  applicable  when  a  =  "^  for  some 

n  >  1.  However,  Levy  (1935),  Khintchine  (1935),  and  Feller  (1935) 
have  studied  the  CLT  problem  when  the  random  variables 
{x  ,  n  >_  1  }  are  i.i.d.  with  EX  =  =.  Their  version  of  the  CLT  may  be 
stated  as  follows. 


Theorem  2.2  (Chow  and  Teicher,  1978,  p.  300).   If  {x,  X  ,  n  >  1 }  are 

2 
i.i.d.  random  variables  with  EX  =  <»,  then 

n 

k=1  •"  "  "^ 

^ ^  N(0,1) 

n 


for  some  B  >  0  and  A„  iff 
n         n 


T   C^P{|X|  >  c}    ^ 
lim  — r-^-J — ' '—  =  0, 

c^-"  EX  I(  |X|  <  c) 


Moreover,  for  all  n  2  1>  B  may  be  chosen  as  the  supremum  of  all 

_2   2  1 

c  >  0  so  that  c  EX  I(  I  X|  <  c)  >^  -,  while  A  may  be  taken  as 


A  =  nEXKlxl  <  B  ),  n  >  1. 
n       '  '  -  n     - 


Proof.  See  Chow  and  Teicher  (1978,  p.  300-302).  D 

Theorem  2.2  was  first  proved  by  using  the  function  H  in  (4) 

while  our  extension  will  use  the  function  G  in  (5)  instead. 

2 

This  chapter  will  look  into  the  CLT  problem  when  n  =  «>,  n  >_  1  , 

n 

for  the  weighted  sum  z  a  X  .  The  CLT  for  jx   n  >  l}  i.i.d.  random 

,  ,  k  k  ^  n'   -  ' 

k=1 


variables,  EX  =  0,  Var(X  )  =  1,  (a  ,  n  _>  1  }  nonzero  constants 

n  ^         „      n  ^ 
2         2         2 
with  E  a,  ->■  "  and  a  =  o(  E  a,  )  is  an  easy  application  of  Theorem 

k  =  1  ^  "     k=1  "^ 

2.1  (see,  e.g.,  Chow  and  Teicher,  1978,  p.  302). 


2.2  Preliminary  Lemmas 

2 
To  study  the  CLT  problem  when  a  =  =>,  one  must  examine  a  special 

class  of  functions.  A  function  g  is  said  to  be  slowly  varying  (at 

infinity)  if  for  all  s  >  0,   g(sx)  -  g(x)  as  x  >  «>.   Closely  related 

to  slowly  varying  functions  are  those  that  are  regularly  varying.  A 

function  h  is  said  to  be  regularly  varying  with  exponent  p 

(-«>  <  p  <  «>)  if  h(x)  =  X  g(x),  for  some  slowly  varying  function  g.   A 

useful  property  of  every  positive  slowly  varying  function  is  that 

(see  Rosalsky,  1981 ) 


log  g(x)  =  o(log  x)  as  x  ^  °° 

(3) 
(and  hence  g(x)  =  o(x  ),  all  a  >  0). 


The  question  at  hand  is  what  condition  should  -we  place  on  the 

sequences  of  constants  la  ,  B  ,  e  ,  n  >  1 }  and  the  i.i.d.  random 

^  n   n   n    -  ' 

variables  fx  ,  n  >  1 }  to  ensure  that 
'  n    -  ' 


n 

I  a,  (X,  -e,  )  , 
k  k  k  d 

^^ g N(0,1) 

n 


when  Var(X  )  =  =>.  As  will  become  apparent,  we  need  to  know  at  which 


rate  the  variance  of  the  variables  approaches  infinity.  This  is 
where  the  notion  of  slow  variation  will  be  applied.  We  define  H,  the 
truncated  second  moment  of  X,  by 


H(x)  =   EX^I(|X|  <  x),  X  >  0.  (4) 


Another  function  of  interest  is  G  defined  by 


G(x)  =   j   2tP{|x|  >  t}dt,  X  >  0.  (5) 

0 


The  functions  G  and  H  were  used  by  Rosalsky  (1981)  to  prove  a 
generalized  law  of  the  iterated  logarithm  for  weighted  sums  with 
infinite  variance. 

The  first  lemma  will  be  used  to  establish  a  relationship  between 
H  and  G. 

Lemma  2.1.   For  every  random  variable  X  and  positive  constant  p, 


p/   tP"V{Ix|    >   t}dt  =   sPp{|x|    >   s}   +   E|X|PI(|X|    <   s) 
0 


for  all   s  >  0. 

Proof.   Let  F,  ,  denote  the  distribution  function  of  the  random 
variable  |x|  ,  that  js,  F|yi(t)  =  P{|x|  <_  t}.   For  s  _>  0,  integration 
by  parts  yields 


10 


S  S 

/   tP'V{|x|    >    t}dt   =    /   tP'\l-F|     |(t))dt 
0  0  '     ' 


s  s 

=  -[tPp{|x|    >   t}|       W    t^dF.     |(t)] 

P  0        0         1^1 


-[sPp{|x|  >  s}  +  e|x|Pi(|x|  <  s)].  D 


Using  this  lemma,  with  p  =  2,  we  obtain 


G(x)  =  x^p{|x|  >  x}  +  H(x),  X  >  0.  (6) 


It  should  be  noted  that  G  is  nondecreasing,  continuous,  and 

2 
G(x)/x  +  0  as  x  +  «>  (see  Rosalsky,  1981). 

Other  relationships  between  G  and  H  which  will  be  used 

throughout  this  chapter  are  given  in  the  next  lemma. 

Lemma  2.2.   (Rosalsky,  1981).   The  following  are  equivalent: 


G  is  slowly  varying. 


H  is  slowly  varying, 


G(x)  -  H(x), 


x^p{ |X|  >  x}/G(x)  =  0(1  )  as  X 


X  P{|X|  >  x}/H(x)  =  0(1 )  as  X  ^ 


11 


At  this  point  we  note  an  interesting  fact.   If  the  random 
variable  is  not  in  ^-2.  then  by  the  following  lemma  it  is  in  ^  for 
all  0  <  p  <  2  provided  H  (or  equivalently  G)  is  slowly  varying. 

Lemma  2.3.   If  H  is  slowly  varying,  then  X  e  ^   for  all  0  <  p  <  2. 

Proof.  By  Lemma  2.1  we  obtain 


E|X|P  =  pj  tP~V{|x|  >  t}dt 
0 


whether  or   not  X  e  j^  .  This  follows  by  considering  the  two  cases; 
E|X|^  <  ■=»  or  E|x|P  =  ".   Let  0  <  a  <  2-p.   Then  via  (3),  Lemma  2.2, 
and  the  hypothesis  that  H  is  slowly  varying,  there  exists  a  number  t^ 
such  that  if  t  >  t  ,  H(t)  <  t"'  and  t^P{|x|  >  t}/H(t)  <  1.  Thus, 
t^p{|x|  >  t}  <  t^*  or  p(  |X|  >  t|  <  t'^~^   whenever  t  >  t  .  Hence 

t 

E|X|P   =    pJ    °   tP~^P{|x|    >    t}dt   +    pj^    tP~V{|x|    >    t}dt 
0  ^o 

<  /'°  ptP-^dt  .  pi  tp'^'-s^t 

0  ^o 

=   tP  -  ^tP*"'-^  < 
o       p+a-2  o  ' 

since  p+a-2  <  0.     D 

One  thing  to  note  is  that  slow  variation  of  H  ensures  in 
particular  that  E|x|  <  «>.  This  allows  us  to  establish  a  lemma  which 
takes  advantage  of  Lemma  2.1. 
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Lemma  2.k.     For   any  oL.    random  variable  X  and  constant  c  _>  0 

00 

e|x|i(|x|  >  g)  =  cp{|x|  >  c}  +  I  p{|x|  >  t}dt. 

c 

Proof.  We  apply  Lemma  2.1  twice,  first  with  s  =  »  and  then  s  =  c;  in 
both  cases  we  let  p  =  1.  Therefore, 

e|x|i(|x|  >  c)  =  E|xj  -  e|x|i(|x|  <  c) 


J  P{|X|  >  t}dt  -  [/  P{|X|  >  t}dt  -  cP{|x|  >  c}] 
0  0 


cp{|x|  >  c}  +  J  p1|x|  >  t}dt.  D 


Before  we  proceed  with  our  main  result  of  this  chapter,  we 
conclude  this  section  with  one  last  lemma.  Note  that  the  hypothesis 
of  Lemma  2.5  ensures,  via  (3),  that  X  e  Xi- 

Lemma  2.5.   If  P{|x|  >  x}  is  regularly  varying  with  exponent 
p  <  -1 ,  then 


E|X|I(|X|  >  c)  =  (1+o(1))(-2y)cP{|xI  >  c}  as  c  ^  ". 

Proof.   We  apply  the  following  result  in  Feller  (1971,  p.  281):   If 
p{|x|  >  x}  is  regularly  varying  with  exponent  p  <  -1 ,  then 


J  P{|X|  >  t}dt  =  (1+0(1))(^)P{|X|  >  c}  as  G 
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Using  this  and  Lemma  2.4  we  obtain 


:|X|I{|X|  >  c)  =  cP{|xl  >  c}  +  /  P{|X|  >  t}dt 


=  CP{|X|  >  c}  *  (U0(1))(^)P{|X|  >  c] 


(1+o(1))(-^)cp1|x|  >  c}.  D 


■p+1 


2.3  Mainstream 
With  these  preliminaries  accounted  for,  we  are  ready  to  state 
and  prove  our  first  major  result,  but  first  we  need  a  version  of 
Theorem  2.1  which  establishes  a  CLT  for  triangular  arrays. 

Theorem  2.3.  Suppose  that  for  each  n  the  random  variables 

X X    are  independent  and  satisfy  EX  ,  =  0, 

n1  nr  ■'   nk 

n 

r 

a^,  =  EX^,  ,  3^  =   z"  0^,  for  1  <  k  <  r  ,  n  >  1  .   If 
nk     nk'  n   ,  ,   nk      -   -  n    - 
k=1 


''^  fAK^'^K^\    >  "n^  =  ° 
n-^co  i<=1  s 
n 


r         d 
holds  for  all  e  >  0,  then  e"  X  /s  ^  N(0,1). 

k=1  ^^      " 

Proof.  See,  e.g.,  Billingsley  (1979,  p.  310-312),  D 

There  is  some  notation  that  must  be  presented  and  will  be  used 

throughout  the  entire  chapter.  The  functions  G  and  H  are  defined  as 


1il 


2 
in  (4)  and  (5),  respectively.   Let  Q(x)  =  x  /G(x),  x  >  0,  and  since  G 

is  slowly  varying,  it  is  clear,  via  (3),  that  Q(x)  ->■  <».   It  can  also 

be  shown  that  Q(x)  t  »  (see  Rosalsky,  1981,  Lemma  2).  The  sequence 

Iq  ,  n  >  1  1  is  defined  by  q  =  Q  (n),  n  >  1.   Since  Q(x)  t  <» 
n    -  n  — 

we  note  that  q  +  <».  The  next  sequence  of  interest  is  Is  ,  n  >  1  } 
n  '  n    -  ' 

which  is  the  sequence  of  partial  sums  of  the  squares  of  the  weights, 

2    "   2 
i.e.,  s  =  Z  a  ,  n  >_  1 ,   Finally,  we  define  the  positive  constants 

"   k=1  ^ 

Ib  ,  n  >  1 }  via 
'  n    -     ' 


B^  =  — q^.  n  >  1.  (7) 

n    n  n    — 


The  first  main  result  follows. 


Theorem  2.U.      Let  |x,  X  ,  n  >  ll  be  i.i.d.  random  variables  with 
'    n    -     ' 

EX^  =  "  and 


x  Pflxl  >  x}     ,,  -  ,Q. 

4r7-h =  o(1)  as  x  -*  «=.  (8) 

H(x) 


Let  la  ,  n  >  1  }  be  constants  such  that 
'  n    -  ' 


B  B 

G(-^ T r)  -    G( T r)  (9) 

fninlaj  "lax    |a7T 

1<k<n  1<k<n 


and 


n 

Z  P{|X|  >  eB  /|a  |}  =  o(1 )  for  all  e  >  0.  (10) 

k  =  1  "   ^ 
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Then 


n 

E  a,  X,  -A     ^ 
k  k     n  d 

^^^1-g ^  N(0,1)  (11) 

n 


where    JB   ,    n  >   1  I    is   defined  as  in   (7)   and 
'   n         - 

n 
^n  =     ^  \EXI(|X|    <   B^/|aJ),   n  >   1. 
k=1 

Proof.   Via  Lemma  2.2,  we  see  that  (8)  implies  that  G  is  slowly 

2 

varying  and  that  G(x)  -  H(x)  ->■   «>  (since  EX  =  ")  .  Note  that 


G(q  )  =  B^/s^  (12) 

^n     n  n 


since 


n  =  Q(q^)  =  q^/G(q^)  (13) 


2   „2 
q    B 

and  hence  G(q  )  =  —  =  -^  (by  (7)). 
n     n    2 
s 

n 

Utilizing  G(x)  +  «>  and  q  ^  «>  we  obtain  via  (12)  that 


3^/B^  =  0(1).  (14) 

n  n 


Noting  that 


B  s  q  s  q  B        B 

n  n  n     ^    .      n  n         n     x   n      r,n\ 

>  q  > = 1 r  >  —  ->■'='   (15) 


mm  a,  ,-  .   ,   ,  -  ^n  -  /-     i   i  max  a,   -  s 
,  ,,  ,  '  k '  /n  min  a,  /n  max  a,  w,  ^   •<     " 
<k<n  ,  X,  ^   ki  w.  /   k'  l<k<n 
1<k<n  1<k<n  
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and  G  is  nondecreasing,  it  follows  that 


s   q  3   q 

G( "^^ )  >   G(q    )    >   G( "^ ),    n   >   1 

/n  min    |a    |  "  i/n  max    |a    | 

1<l«n  1<k<n 


Using  the  fact  that  G  is  slowly  varying  together  with  (9)  and  (15)  we 
obtain 


s  q  s  q 

G( "^ )  -  G(q  )  -  G( ^^ ).  (16) 

/n  min  |a  |       ^  /n  max  |a  | 

l<k<n  1<k<n 


Next,  we  will  show  that 


g^  k=i  '^   "   ^ 

n 


Since  H  is  nondecreasing, 


4  ^  \^^\^\\\^  ^~l     ^  \H(B  /  max  |a  1) 
B^  k=l  ^  B^  k=1  ^       "  1<j<n  ^ 

n  n  -^- 


2 
3      s  q 

-|h( !^-^^ )  (by  (7)) 


B   v^  max  la . I 
n        '  1  ' 
l<j<n  •J 


2 

s       s  q 

(1+0(1  ))-jG(-3 ^^-2 )  (by  Lemma  2.2) 

B   /n  max  I  a . I 
n        '  1  ' 
1<J<n  ^ 
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2 

s 

(1+o(1))^G(q  )  (by  (16)) 

B 
n 


1+0(1)  (by  (12)) 


Similarly, 


^  J:  a^H(B  /|a  |)  <  —  Z  a  H(B  /  min  |a  |  ) 

B'^  k  =  1  "   "   "     B^  k  =  1  "   "  1<j<n  ^ 
n  n  


2 
s      s  q 

^H( '^^ )  (by  (7)) 

B  /n   min  la.  I 

Kj<n  -J 


2 
s      s  q 

<^G( 2J} )  (by  (6)) 

B  /n   min  la . I 

"    1<j<n'  j' 


2 

s 

(Uo(l))^G(q  )  (by  (16)) 

B 
n 


=  1+0(1)  (by  (12)) 


Combining  these  two  results  yields  (17). 

Define  X^^"  =  X^^K  \^^y^^^\   1  B^)  ,  1  <  k  <  n,  n  >  1  ,  and 

n  "    (n)    2 

S  =  E  a,  X,  ,  S'  =  I  a,  X,   ,  Y  =  Var(S'),  n  >  1.  Now  via  Lemmas 
n  .^.    k  k'   n   ,  ^.  k  k     n       n     - 

2.2  and  2.3  and  (8)  we  note  that  X  e  ^  .  Therefore, 


4  I  a^(EXI(|x|  <  B  /|aj))2 

B  k  =  1 
n 


B^^  k  =  1  ^ 
n 


2 

=  ^(E|X|)^  =  0(1)  (by  (14)). 

B 
n 

2    2 
Using  this  result  and  (17)  we  conclude  that  Y  -  B  as  follows; 

n         n 


?     ?  1  " 

Y   /B      =  -:!r  Var (    Z   a,  X,  I(  I  a,  X,   I    <   B    )  ) 
nn       „2  ,,l<kil<k'-n 

B  k  =  1 

n 

=  j:  a  Var(XI(|x|    <   B  /|a    |)) 

b"^  k  =  1    '^  "       " 

n 

=  -1     I   aWl(|x|    <   B   /|a    |)    -  4     Z   a2(EXI(|x|    <   B   /laj))2 

B  k=1  B  k=1 

n  n 

=  4  ^   \^^\^\\\^    -  ^     ^  \(EXI(|X|  <  B  /ja  |))2  -  1. 
B^  k  =  1  "   "   ''     B^  k  =  1  "  "   ^ 

n  n 


Next,  noting  that  X  c  ^  and 


a^(EX^"^2        a^(EXI(|x|  <  B^/|aJ))2 

max =  max  r 

1<k<n     B        1<k<n  B 
n       n 


Za^(EXI(|x|  <3^/|aJ))2   32   |  ^  |  2 


b2  -    B^ 

n  n 


0(1)  (by  (14)) 
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and  hence 

.(n) 


|a  ||EX   , 

max       Q =0(1).  (18) 

1<k<n      n 


We  can  now  establish  that  the  normed  sum  of  the  truncated 

variables,  ,  converges  in  distribution  to  a 

n 
standard  normal  random  variable. 

Let  £  >  0.   Clearly  Y  -  B  and  (18)  ensure  that  for  all  large 

n         n 

n,     max    | 1    <   e/2. 

1<l<<n  n 


,    N  eY 

(n) 


Hence  for  all  large  n  and   1    <   k  <  n,    |EX/;"    |    <  ^i    "i    or, 

equivalently,    EX,  <   ^i    "i    and  EX,  >   ^i    "i    .      Thus  for  all  large  n 

k  -  2|a^|                 k  -  2|a|^| 

and  all    1    <   k  <   n. 


=    lX<"'-EX<"'<-.Vl^llUIX<"'-EX<">>.VKII 
.|x^"'<EX^">-.V„/|aJIUlx<"'>EX<"'*cV„/|a,n 


cir  <^i^i<"'>5ra 


^l^k    I  >  2TrTt 


ki 

eT 
j; 

^k' 


20 


Thus,    for  all   s   >  0,    and  all  large  n, 


-lj^E(a,X^"'-EaX"')^I(|V^"'-Ea,X^"'|>c.„) 
n 

<-|  j^a^^E(X<">-EX<"')==I(|x^"'-EX<"'|    >  cVlaJ) 
n 


(since   Y      ~   B   ) 
n         n 


n 


(by  the  previous  observation) 


<ii,\^'<'''*<^^^"'>''i<|x<"'l>5;A) 


B  k=1 
n 


2      2   2 
(using  the  elementary  inequality  (a-b)   <  2(a  +b  )) 


-|j^a^E(X^"¥l(|X^"'|>5fA. 
n 


^^J,\<'''^l|x<">|>5^) 


4   2    I   r  2 

This  second  sum  is  o(1)  since  it  is  dominated  by  — p  s  (E|x|)  , 

B 
n 


wni 


ich  is  o(1),  recalling  X   e    ^     and  (1^4).   The  first  sum  is  equal  tc 


n 
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„  n  „   eY  B 

<  -4  I   B^PJ-"  <  |x  I  <   " 

-b2  k=i  "  ^fij  '  ki  -]t;;^ 

n 


eT 


<  4  Z  P  IX,  I  > 


k=l    ^'    2|a^ 


eB 


<  4  E  pflxl  >  .,  I  "if      (for  all  large  n  since  Y  -  B  ) 
k=1        ^\W  "    " 


=  0(1) 


(by  (10)). 


Therefore  by  Theorem  2.3 


S'-ES'    d 
n       n 


N(0,1) 


(19) 


Let   6   >  0.      Then 


S   -S ' 


<  P{    Z  a,  X,     *     Z  a,  X,     M 
-       k  =  1    ^^       k  =  l    '^  >< 


<P{[J'^\\\    >   Bn/|^.Nf 


k=1 


k'         n    '    k' 


^J/^l\l    >^n/|\l^    =   °^^ 


(by    (10)) 


and  so 


S   -S'    P 
n 


(20) 
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Hence 


S    -ES'        S    -S'+S'-ES' 
n       n  _     n     n     n       n 

B         "  B 

n  n 


S  -S'  Y       S'-ES'      d 

^^   (^)(-V^)    ^N(O.I) 
n  n  n 


(by    (19),    (20),   B     -  Y   ,    and  Slutsky's  theorem) 
n         n 


Finally,    noting  that 


n  ,  .  n 

ES '    =   E     I   a,  X,         =   E      E   a,  X,  I(  I  X,  I    <   B   /  I  a,  I  ) 
n  ,,kk  ,,kk      'k'— n'k' 

K=1  k=l 


=      la^EX^KlxJ    <   B^/|aJ)    =  A^, 
k  =  1 


the  conclusion  (11)  follows.  Q 

With  this  result  in  hand,  it  is  natural  to  ask,  under  what 

conditions  is  A  /B  =  o(l)?  It  would  seem  natural  to  assume  that 
n  n 

EX  =  0,  but,  that  in  addition  to  the  other  hypotheses  of  Theorem  2.^, 
does  not  seem  to  ensure  that 


n 

^  3,  X,  ^ 
k=i  K  k  d 

^ ^  N(0,1).  (21) 

n 


It  will  be  shown  that  we  need  to  strengthen  condition  (8),  and  then, 
with  a  little  help  from  Lemma  2.5,  (21)  will  follow. 


23 


Lemma  2.6.   If  P{|x|  >  x}  is  regularly  varying  with  exponent  -2,  then 
G  is  slowly  varying. 

2 

Proof.  Without  loss  of  generality  assume  that  EX  =  ».  Let 

6  >  0,  s  >  0.   Since  P{|x|  >  x}  is  regularly  varying  with  exponent  -2, 


1-6    <   ^   f^ 


TT 


If  V  ,,!^     <   ■'+<5   for  all   X  >   some  x    .  (22) 


Thus,  for  all  x  >  x 
—  o 


sx 


G(sx)  =  I  2tP{|x|  >  t}dt 
0 


sx  sx 

J    2tP{|x|  >  t}dt  +  /   2tP{|x|  >  t}dt 

0  sx 

o 


G(sx  )  +  2j   ys-^PJIxl  >  ys}dy 


o 

X 

o 


-A 

<  G(sx  )  +  (1+6)2j   yP{ix|  >  y}dy  (by  (22)) 


X 

o 


=  GCsx  )  +  (1+6)(G(x)-G(x  )) 
0  o 


implying  that 


,      .        G(sx  )  G(x  ) 


2H 


Taking  the  limit  superior  of  both  sides  as  x  ^  «>  yields 


lim  sup  ^^Ify  <  T+6.  (23) 

X-xx 


Likewise,  for  all  x  >  x 

—  o 


"   2, 


G(sx)  =  G(3X  )  +  2/  ys  p1|x|  >  ys}dy 


o 

X 

o 


-A 
>  G(sx  )  +  (l-6)2j   yP{|x|  >  y}dy      (by  (22)) 


G(3X  )  +  (1-5)[G(x)-G(x  )] 
o  0 


implying  that 


,   .   G(sx  )  G(x  ) 

G(sx)   o_   n-^Ui 2_n 

G(x)  ^  ^UT        ^^    ^^^^        ~GU)^' 


Taking  limit  inferiors  as  x  -»■  "  in  this  last  inequality  yields 


lim  inf  ^^7^  >  1-6, 
X-    G(x)  - 


Since  6  is  arbitrary,  the  desired  result  follows  from  this  and  (23). D 
The  converse  to  Lemma  2.6  is  false;  for  a  counterexample  see 

Feller  (1971 ,  p.  288). 

At  this  point  we  are  prepared  to  prove  a  CLT  without  the 

centering  constants  JA  ,  n  >  l|. 

'  n    —     ' 
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Corollary  2.1.   If  {x,  X  ,  n  ^  l}  are  l.i.d.  random  variables  with 
EX  =  0,  EX  =  °°,  P{|x|  >  x}  regularly  varying  with  exponent  -2,  and 
if  (9)  and  (10)  are  satisfied,  then  (21)  holds. 


Proof.   By  Lemmas  2.6  and  2.2,  condition  (8)  holds.   In  view  of 

Theorem  2.4  it  suffices  to  show  that  A  /B  =  o(1).  Since 

n  n 

p{|x|  >  x|  is  regularly  varying  with  exponent  -2,  we  obtain  via  Lemma 
2.5  with  p  =  -2  that 


E|x|l(|x|  >  x)  <  3xP{|x|  >  x}  for  all  x  >  some  x  .        (24) 


Recalling  (15),  we  note  that  B  /  max  |a  |  ->•  ■»,  whence  there 

"  1<k<n  ^ 

exists  an  integer  n_  so  that  B  /  max  la,  I  >  x  whenever  n  >  n  . 

0         n.^.^'k'-o  -o 

Kk£n 

So  if  n  >  n  ,  we  obtain  B  /la,  |  >  x  for  all  k  =  1,  .  .  .  ,n. 
-  o  n  '  k  I  —  o 

Thus  (24)  implies 


B 
^k 


E|X|I(|X|    >  B^/[aj^|)    <   3y^P{|x|    >  B^/|a^|  }  whenever  n  >  n^. 


(25) 


Therefore  when  n  is  sufficiently  large, 


1  " 
Ia  /B  I  =  — I  Z  a,  EXKlxl  <  B  /la,  |)| 
'n  n'    B',k    ii—  n'k'' 

n  k=1 


1   " 
^|-  T.   a  EXI(|X|  >  B  /|a  |)|         (since  EX  =  0) 

n  k=1 


1      " 
<  r     2    |ajE|x|l(|x|    >   B   /|aj) 

n  k=1 
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<i     h\\j^H\x\    >   B^/|aJ}  (by    (25)) 


n 
3   Z   P{|X|    >   B  /ja    1}   =  o(1)  (by    (10)).    Q 

k=1  "       ^ 


The  following  two  corollaries  will  be  shown  to  be  immediate 
consequences  of  Theorem  2.4. 


Corollary  2.2.  Let  {X,  X  ,  n  >_  l}  be  i.i.d.  random  variables  with 

2 

EX  =  »  and  satisfying  (8).   Let  (a  ,  n  >  1 }  be  constants  so  that 

n    — 


2      2 
n  max  a  =  0(s  )  (26) 

1<k<n  ^  " 


and 


^^  minla  1^  -^(^n^-  ^^7) 

1<k<n 


Then  (11 )  holds. 


Proof.   In  view  of  Theorem  2.H,   we  only  need  to  verify  that  (9)  and 

(10)  prevail. 

^n  ^ 

Let  a  =      I   I  ,  n  >  1  ,  and  observe  that  a  >  —  ^  «>.   By 
n    max  |a  |    —  n  —  s        •' 

1  <  k  <_n 

n  max  a 

l<k<n 

(26),  there  is  some  constant  C  <  "  such  that  ^ <C    ,   n  >_  1  . 

s 

Then  '^ 
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2  2 

n  max  a  max  3,     „ 

l<k<n  1<k<n    nB     q 

C  >  ^ =  ( ^ )(^)  =  ^         (by  (7)), 

s„  B      s      a 

n  n     n     n 


3 

and  clearly  <  i  implying  that 

/n  max  |a  | 
l<k<n 


%  <  ^n  -  ^%'  "  >  ^-  (28^ 


For  arbitrary  e   >  0,    note  that 


C  n 
2 

nH(q    ) 

2 
'In 

nG(q^) 

%^ 

(since  (8)  implies  that 
H  is  slowly  varying) 


(since  H(x)  -  G(x) 
via  (8)) 


(by  (13)). 


Thus 


nH(§q^)  -  q2.  (29) 


Then,  for  all  arbitrary  e  >  0  and  n  sufficiently  large 


n 

Z  P{|X|  >  eB  /ia  1} 
k=1        "   ^ 


<   E  P||X|  >  eB  /  max  la. 
k=1  1<j<n  -^ 


28 


nP{|x|  >  ea^; 


<  nP{ix|  >  ^^}  (by  (28)) 


(  )   . . 


(1+o(l))(-)^  -^^-^^ ^^^     (by  (29)) 


=  0(1)  (by  (8)) 

thereby  proving  (10). 

To  prove  (9),  in  view  of  (27),  we  need  only  show  that 


B 

n      max  | a  | 
1<k<n 


Note  that    (28)    entails 


ttQ     <  1 — r  <  Q  • 

C^n  -     max    |a    |   —     n 

1<l«n 


29 


utilizing  the  fact  that  G  is  nondecreasing  we  obtain 


1  ^ 

G(pq„)  <  G(— — y— r)  <  G(q  ). 
C  n  —    max  |a  |  —    n 

Kk<n 


Thus  (30)  holds  since  G  is  slowly  varying.  □ 


Corollary  2.3.   Let  {x,  X  ,  n  >  l}  be  i.i.d.  random  variables  with 

2 

EX  =  "  and  satisfying  (8).   Let  la  ,  n  >  1 }  be  constants  so  that 

n  -  ' 


2        2 
0  <  inf  a  <  sup  a  <  <»  (31  ) 

n>1      n>l 


then 


n 

,  _.  k  k  n  d 

^^^-^-g ^  N(0,1) 

n 


where  {a^,  n  >^  1  }  is  defined  as  in  Theorem  2. 4, 


Proof.   Again  we  will  verify  that  (9)  and  (10)  are  satisfied. 
Clearly, 


B         B  B  B 

n    <  V-r  <    ■  "i   I  <  ^   " 


sup  |a  I  -  max  |a  |  -  min  |a  |  -  inf  |a J 
k>1   ^    l<k<n      1<k<n      k>1 


which,  since  G  is  nondecreasing,  implies  that 
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k>1  Kk<n  1<k<n  k>1 


Recalling  that  (8)  is  equivalent  to  G  slowly  varying  we  obtain 


B  B 

k>1   ^  k>l   "^ 

by  employing  (31).  Hence  (9)  obtains. 

Define  a  =  B  /  max  |a  |  and  8  =  B  /  rain  |a  | ,  n  >  1,  and  note 
1<k<n  ^      n    n  ^^^^^^  k 

B 
that  B^  >  a^  >  —  -*•  ".   In  light  of  (31),  there  exists  constants 

n 
0  <  C^  <  C^  <  "»  such  that 


C  _<  min  |a  I  <  max  |a  |  <_  C  ,  for  all  n  >  1 
1<k<n      1<k<n  ^  '^ 


2     2   2 

Recall  that  q  =  nB  /s  and  thus 
n     n  n 


B  B 


Again  using  the  fact  that  G  is  nondecreasing  we  obtain 


G(^)  <  G(a^)  <  G(q^)  <  G(^) 


This  together  with  G  slowly  varying,  ensures  that  for  all  s  >  0 


H(ea^)  -  G(ea^)  ~  G(ct^)  -  G(q^)  (33) 
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From   (32)    it  follows  that 


or 


1  ^2^1 

4<(^)      4.  (3i^) 

a  1        q 


Thus,   for  all    e   >  0, 


nH(ea   )        (1+o(1))nG(q    ) 
n_  ^  _n_ 

2  '  2 

a  a 

n  n 


whence 


nH(ect   ) 
n 

2 

% 


Therefore  for  arbitrary  e   >  0, 


(by   (33)) 


Cp   2  nG(q    ) 
<    (l+o(l))(^)  „  "  (by   (34)) 

1  q 

n 

C      2 
=   (Uo(1))(p^)  (by   (13)) 

^1 


=   0(1).  (35) 


n 

I  P{\X\    >   eB^/|aJ}    <   nPl|x|    >   zaj 

(ea   )'"P{|xl    >   ea    }        nH(ea   ) 
1  n        ^ '     '  n'  n 


2  H(Ea   )  2 

e  n  a 

n 


=  0(1)  (by    (8)   and   (35)) 


thereby  establishing  (10).  D 
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Theorem  2.4  does  have  a  partial  converse.  We,  however,  impose  a 

relatively  strong  condition  about  the  weights  la  ,  n  >  l}. 

n    -  ' 

Remark .   Let  {x,  X  ,  n  >_  1  }  be  i.i.d.  random  variables  with 
EX  =  ">.   Let  {a  ,  n  >_  1  }  be  a  sequence  of  constants  where 


2  2 

s  =  0(n  min  a,  ).  (36) 

1  <k<n 


Then  (11)  implies  (8)  and  (10). 

Proof.   By  (36)  there  exists  a  constant  0  <  C  <  «>,  such  that 

2 
s 

2  -  ^'  "  2.  ^  »  which  implies  that 

n  min  a 
1<k<n 


2 
n  min  a. 

C  <  2 ♦  ^°^  ^^^   n  >  1  .  (37) 

s 
n 

2 
Note  that,  by  definition  of  H,  H(x)/x  =  o(1)  as  x  -*  ». 

2  2 

Then,  recalling  (6),   G(x)/x  =  o(1),  whence  Q(x)  =  x  /G(x)  ^  » 

as  X  ^  ".   This,  in  turn,  shows  that  q  -»■  ».   Therefore 

n 

2    2 
^n  "  ^n'^^^n^  ^  °°  ^"^ 

B  B      B 

n    .  n    .   n  ,^_. 

>  ^..^  U  I  >  —  ^  "•  (38) 


min  |a  I  -  max  | a  |  -  s 
1<k<n  ^  1<k<n  ^  " 


If  we  can  show  that 


max  P(|X|  >  6B  /|a,  |}  =  o(1)  for  all  5  >  0,  (39) 

1<k<n         "  ^ 
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then,  employing  Corollary  12.2.3  of  Chow  and  Teicher  (1978),  we  can 
conclude  that  (10)  holds  and 


1   "  2  ? 

-2  I   a|^[H(eB  /|a  |)  -  (EXl(|x|  <  gB  /|a J))'']  >  1  for  all  e  >  0. 
B  k  =  1  n   k 

n 


(40) 


So  to  establish  (39),  note  that  for  arbitrary  6  >  0 


max  P{|X|  >  6B  /|a  1} 
1<k<n         '^       ^ 


P{|X|  >  68  /  max  |a.  | 
"  1<k<n  ^ 


<  p1|x|  >  6B^/s^} 

=  0(1)  (by  (38)) 

whence  (39)  obtains.  Then  using  (10)  and  (40),  we  conclude  that  for 
e  =  1 


n 

^  p1|x|  >  B  /|a  1} 

k  =  1 
o(1)  =  -  ^    ^ 


n 

—  E  a  [H(B  /|a  |)  -  (EXI(|x|  <  B  /|a  1))^] 
B  k  =  1  n   K 

n 


.2      ^ 


B   Z  P{|X|  >  B  /|a  |} 
^  _   k=1        "   ^ 


n 
2. 


E  a,  H(B  /la,  1) 


3^ 


.2     " 


B        E   P{|X|    >   B^/  mm    |aj} 
k=1  l<k<n 


"2 

I  a,  H(B  /  min     a,     ) 

k=1  l<k<n 


nejpllxl  >  B^/  min  |aj} 
Kk£n 

s^H(B  /  min  la,  I  ) 
n   n  ,  .,  .  '  k' 
1<k<n 


n  min  a  P{|^|  >  B  /  min  |a  | 

1<k<n  B     ^            l<k<n 

/ n   x2   -  - 

2  '  ^  min  | a  | '^   *     H(B  /  min  |a  |  ) 

n  1<k<n               1<k<n 


P{|X|  >  B  /  min  |a  1} 
^     B     2  "  1<k<n  " 

^C^  min  |a  1^ H(B  /  min  |a J)        (by  (37)) 

1<k<n  ^  "  1<k<n 


Thus 


p1|x|  >  B  /  min  |a.  |1 


B     2  ll^ln 

■ n   \  _  p.  /■  1  ^ 

min  |a  l'^  *   H(B  /  min  |a  |  )     " 
1<k<n  ^  "  1<k<n 


Then  for  all  x  such  that 


B  2B 

n  .        .  n 

<    X    < 


min    |a    I   -       -     niin    |a    | 
1<k<n  1<k<n 
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we  observe  that 


p{|x|  >    ■  y  |} 


^  ^Ul^k^  ''^  <  (   .   ?   i)   •   „,,  ,   . \ r^   (since  H(x)t) 

H(x)     -   min  a,        H(B  /  mm  a,  ) 


p1|x|  >  B  /  min  |a  |  } 

8     2  "  1<k<n  ^ 

4( y — r)   .  -. 1 n: =  o(l)    as   x  ^  « 

min  |a  1^      H(B  /  min  |a  |) 

1<k<n  ^         "  Kk<n 


recalling  (38)  thereby  establishing  (8).n 

The  next  corollary  is  an  immediate  consequence  of  Theorem  2.4 
and  this  last  remark.   It  is  the  famous  result  of  L6vy  (1935), 
Khintchine  (1935),  and  Feller  (1935)  cited  previously  as  Theorem  2.2. 


Corollary  2.4  (Chow  and  Teicher,  1978,  p.  300).   If  JX,  X  ,  n  >  1  } 

2 
are  i.i.d.  random  variables  with  EX  =  =»,  then 


Z  X  -A   ^ 

^^^3 ^  N(0,1) 

n 

« 

for  some  B  >  0  and  A  iff  (8)  holds;  moreover,  B  may  be  chosen  as 
n         n  n   •' 

-1  * 

q  =  Q   (n),  n  >  1,  while  A  may  be  taken  as 
n  -  n 


*        ,  , 

A  =  nEXK  X  <  B  )  ,  n  >  1 
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2        2 
Proof.  Clearly,  0  <  inf  a  <  sup  a  <  ",  since  a  =  1,  n  >  1 

n>l  "  "  n>1  "  " 

Also 


n 

A   =   Z  a,  EXI(  Ixl  <  B  /la,  I  ) 
n   L,^i  •<    '  '  -  n  '  k' 


nEXI(|x|  <  B  )  =  A  ,  n  >  1, 


whence  the  sufficiency  portion  of  the  corollary  follows  from 

Corollary  2.3-   Necessity  follows  from  the  last  remark 

2         2 
since  s  =  n  min  a,  .   n 

"    1<k<n  '^ 


2.4  A  Properly  Centered  Central  Limit  Theorem 
We  have  seen  that  (8),  via  Lemma  2.3,  implies  that  X  £  X,  • 
Then,  if  we  assume  EX  =  0,  EX^  =  «>,  (9),  (10),  and  p{|x|  >  x} 
regularly  varying  with  exponent  -2  we  showed  in  Corollary  2.1  that 
(21)  holds.   It  is  natural  to  ask  what  happens  when  the  mean  of  X  is 
finite  but  not  zero.  Can  we  just  shift  the  variables  by  EX  and 
achieve  asymptotic  normality?  In  other  words,  when  does  the  CLT 


n 

E  a,  (X,  -EX)  ^ 

g >  N(0,1)  (41) 

n 


hold? 

At  this  point  we  need  to  introduce  some  new  notation.  Consider 
two  sequences  of  random  variables  JX,  X  ,  n  >  1 }  and  {y,  Y  ,  n  >  l|. 
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The  {x,  X  ,  n  _>  l  }  are  i.l.d.  with  arbitrary  finite  mean,  while  the 

sequence  |y,  Y  ,  n  >  ll  are  defined  by  Y  =  X-EX  and  Y  =  X  -EX, 
n'   -  '  ■'  n    n 

2  2 

n  2  1  •  Again  we  suppose  that  EX  =  °°  and  thus  EY  =  «>. 

The  functions  H  and  G  will  be  defined  as  in  (4)  and  (5). 

2^2  2  -1 

Likewise  s  =  E  a  ,  n  >  1,  Q(x)  =  x  /G(x),  q  =  Q   (n) ,  n  >  1  , 

"   k=1  "^  n 

and  B  =  s  q  />/n,  n  _>  1  •   Similarly  we  need  to  define  analogous 
quantities  in  terms  of  the  random  variable  Y. 
Let 


H  (y)  =  EY^I(|y|  <  y),  y  >  0  (42) 


and 


G  (y)  =  J  2tP{|Y|  >  tjdt,  y  >  0.  (43) 

0 


2         *    -1 
Also  let  Q^(y)  =  y  /G^(y),  Q^^  =  Q^  (n) ,  n  >  1  ,  and 


B  =  s  q  //n,  n  >  1 .  (44) 

n    n  n      — 


Before  we  establish  the  relationship  between  these  pairs  of 
functions  and  sequences  we  need  a  few  preliminary  lemmas. 

Lemma  2.7  (Rosalsky,  1981).   If  l{y)    is  the  inverse  of  the  continuous 

r 
increasing  function  y  L(y),  y  >  0  where  L  is  slowly  varying  and  r  > 

_  J_ 
r 


0,  then  y   X,(y)  is  slowly  varying. 
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Proof.   See  Rosalsky  (1981),  Lemma  6.   Q 

2 

Lemma  2.8.   Suppose  that  H  is  slowly  varying  and  EX  =  «>.   Then 

H  (t)  ~  H(t)  as  t  •>  "  and  H   is  slowly  varying. 


Proof.   Let  y  =  EX  and  recall  that  Y  =  X-p.   Then,  recalling  (42), 
for  all  t  >  0 


H^(t)  =  ey^i(|y|  <  t) 


=  E(X-M)^I(|X-y|  <  t) 


=  EX^I(|X-y|  <  t)  -  2pEXI(|X-m|  <  t)  +  u^EI(|X-m|  <  t), 


Now  for  t  >  0,  since  X  e  ^  via  Lemma  2.3 


l2pEXI(|x-y|    <    t)|    <   2|)j|e|x|    <    ". 


Also  for   t  >   0 


U^EI(|x-y|    <    t)    =   y^P||X-u|    <    t}    <   p^    < 


2 
Therefore,  since  H(t)  -*•  <"  as  t  ^  »  (from  EX  =  «>)  we  obtain 


H  (t)    EX^K  |x-p|  <  t) 


39 


For  t  >  |m|, 


EX^I(|X-y|  <  t)  =  EX^I(y-t  <  X  <  u+t) 


<  EX^I(-2t  <  X  <  2t) 


EX^I(|X|  <  2t)  =  H(2t) 


Also,  for  t  >  2| m| , 


EX^I(|X-vi|  <  t) 


=  EX  I(y-t  <  X  <  (i+t) 


>  EX^(-  -^t  <  X  <  -^t) 


EX^I(|X|  <  ^t)  =  H(^t) 


These  two  results  entail,  for  sufficiently  large  t 


H(|t)   EX^I(|x-y|  <  t)   j^^2t) 
~H(TT  -       H(t)      -  ~H(tT' 


2 

and  since  H  is  slowly  varying  we  obtain  EX  I(|x-u|  <  t)  ~  H(t), 

In  view  of  (^45)  this  yields  H  (t)  -  H(t)  as  t  ->•  ". 
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Finally,  for  s  >  0, 


H^(st)  -  H(3t)         (since  H^(t)  -  H(t)) 


~  H(t)  (since  H  is  slowly  varying) 


H^ (t)         (since  H  (t)  ~  H(t)), 


And  so  H^  is  slowly  varying.   D 

With  this  relationship  between  H,  and  H  established,  we  note 

that  a  similar  relationship  clearly  must  then  exist  between  G^  and  G 

when  H  is  slowly  varying  in  view  of  Lemma  2.2,   The  natural  question 

is  whether  B  ~  B  .   Prior  to  establishing  this  we  need  to  state  two 
n    n 

facts  about  functions  of  slow  variation.  The  following  result  (see, 
e.g..  Feller,  1971,  p.  282)  characterizes  the  class  of  slowing 
varying  functions  and  is  known  as  the  Karamata  representation 
theorem. 

Theorem.  A  function  L(t)  varies  slowly  iff  it  is  of  the  form 


t 
L(t)  =  a(t)exp{/  ^^^ds}  (^6) 


1   ^ 


where  e(t)  -*•  0  and  a(t)  ^  c,  0  <  c  <  «>,  as  t  ^  ». 

This  next  lemma  will  demonstrate  the  value  of  the  Karamata 
representation  theorem  and  is  a  quite  useful  result. 

Lemma  2.9.   If  0  <  u(t)  ~  v(t)  ^  »  as  t  >  «>  and  L  is  slowly  varying, 
then 
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L(u(t))  -  L(v(t)). 

t     - 
Proof.   Since  L(t)  is  slowly  varying,  by  ('46),  L(t)  =  a(t)exp{J  -^-^dy}, 

1   ^ 
where  e(t)  ->■  0  and  a(t)  ->■  c,  0  <  c  <  «>,  as  t  ^  «>. 

Thus, 


L(u(t))  ^  a(u(t)) 
L(v(t))  "  a(v(t)) 


exp 


u(t)   ,  ,      v(t)   ,  . 


max{u(t) ,v(t) }  I  ,  . I 
<  (Uo(l))exp{/  iliZildy}, 

min{u(t) ,v(t)}    ^ 


(47) 


since  a(x)  ->■  c  as  x  ->•  «>  and  u(t),  v(t)  -»■  «>  as  t  ^  «>. 

Using  u(t)  ~  v(t)  ■*  "  and  e(y)  -»■  0  we  observe  for  all  t 
sufficiently  large  that  Ie(y)|  <  1  for  all  y  >  min{u(t ) ,v(t ) 
Hence,  via  (47),  for  all  large  t 


T  Cnri-ii  max{u(t),v(t)} 

t^<(,.o<„,exp|/  Id,, 

mintu(t),v(t)| 


, ,   , , , .max 
(1+0(1 ))—:—, 
min 


u(t),v(t) 


u(t),v(t) 


=  (Uo(1))rnax{^.  ^}  =Uo(1) 


(48) 
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Reversing  the  roles  of  u  and  v  we  obtain  for  all  large  t 

L(v(t)) 


L(u(t)) 


<  1+0(1).  (i49) 


Combining  {^Q)   and  (49)  we  conclude  that  L(u(t))  ~  L(v(t)).n 

2  * 

Lemma  2.10.   If  EX  =  «>  and  H  is  slowly  varying,  then  B  ~  B  . 

n    n 

Proof.   Recall  (42)  and  (43).   By  Lemmas  2.2  and  2.8, 

G(t)  ~  H(t)  ~  H^(t)  -  G^(t)  whence  Q(t)  =  t^/G(t)  -  t^/G^ (t)  =  Q  (t) 

Let  q(t)  =  Q   (t)  and  q^(t)  =  Q^\t),  t  >  0.   Then 
Q^(q^(t))  =  t  =  Q(q(t))  -  Q^(q(t))  (since  Q(t)  -  Q^(t)),  and  so 


Q^(q^(t))  -  Q^(q(t)).  (50) 


-1  /2 
By  Lemma  2.7,  L(t)  =   t    q, (t)  is  slowly  varying  since 

Q^(t)  =  t  /G^(t)  is  increasing  (see  Rosalsky,  1981,  Lemma  2) 

and  G^  is  slowly  varying.   Next,  note  that  if  u(t)  -  v(t)  ->•  «>  then, 

via  Lemma  2.9,  L(u(t))  -  L(v(t)).   Applying  this  to  (50)  we  see  that 


L(Q^(q^(t)))  -  L(Q^(q(t))) 


or 


[Q^(q/t))]"^^^  .  q^(Q^(q^(t)))  -  [Q^  (q(t) )  ]"^  ^^  •  q^(Q^(q(t))) 


which,  via  (50),  is  tantamount  to 


^3 


q^(Q^(q^(t)))  -  q^(Q^(q(t))) 


-1  * 

Using  q,(t)  =  Q,  (t)  we  obtain  q, (t)  -  q(t)  or  q  ~  q  . 
I       1  Inn 

Therefore,  recalling  (44)  and  (7), 


B  =  s  q  //n  ~  s  q  //n  =  B  .  Q 
n    n  n      n  n      n 


2 
Lemma  2.11.   If  EX  =  »  and  H  is  slowly  varying,  then 


B  B 

G{—. J r)  ~  G( ? r) 

mm  |a  I       max  |a  | 
Kk<n         1<k<n 


iff 


B  B 

G.(     .     y  ,)  -  G,( n — r) 

1      min    |a  I  1     max    |a    j 

1<l«n  1<k<n 


» 

Proof.   From  Lemma  2.10  we  have  B  ~  B  .   Now  H  slowly  varying 
n    n  J  J     a 

implies,  via  Lemma  2.2,  that  G  is  slowly  varying.  Hence  by 

* 

B  B 

n         n  ,  ^  . 

— -T— — I— — r  -  — : 1 r  ->■  <»  we  Obtain 

min  fTJ    min  \a    \ 

1<k<n      1<k<n 


^^  min  la  I  ^  ~   "^^n^fcf)       ^^^  ^^'"'"^  ^.9) 


1<k<n  ^  1<k<n  ^ 


4i» 


* 

B 

G  ( — r-^ r)  (by  Lemmas  2.8  and  2.2).         (51) 

I   rain  |a  I 

1<k<n 


Likewise 


*  * 

1<k<n         1<k<n  1<k<n 


B  B 

Thus,  if  G( — : — T — r)  ~  G( ^ r),  then 

mm  |a  I      max  |a  | 

1<k<n         Kk<n 


« 

B  R 

1<k<n         Kk<n 


~^^   max"|a  1^  ~  ^^^—a^J^J^  ^^^  ^52)) 

l<k<n  1<k<n 


B  B 

Conversely,  if  G.  (  ^.  "i  i)  -  G,  ( ^ r)  ,  then 

I  min  |a  I     1  max  |a  |  ' 

1<k<n  1<k<n 


B  B 

G( : T r)  ~  G,( rA r)       (by  (51)) 

min  |a  I  1   mm  |a  |       ^   y    \j>  j  / 

1<k<n  l<k<n 


B  B 

'/max  |a  1^  ~  "^ax  |a  J  ^    ('^^  ^^2)).  Q 
1<k<n         l<k<n 
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2 
Lemma  2.12.   If  EX  =  «>,  H  is  slowly  varying,  and 


n 

E  P{|X|  >  eB  /|a  11  =  o(1)       for  all  e  >  0, 
k=1         "   ^ 


then 


I   p||y|  >  eB  /|a  1}  =  o(1)       for  all  e  >  0. 
1<=1         "  ^ 


Proof.   Let  e  >  0.  By  Lemma  2.10,  there  exists  a  constant  M  <  «= 
such  that 


B  /B  <  M    for  all  n  >  1 .  (53) 

n  n  -  -  ^ 


Recall  that  B^/  max  |a  |  -»■  «>  and  so  if  n  is  sufficiently  large,  then 
Kk<n 
eB 

>  \u\    for  all  k  =  1,  .  .  .  ,n  where  p  =  EX.  Therefore 


2M  a, 
'  k 


Z  P{|Y|  >  eB  /|a  1} 
k=l        "  ^ 

n  eB 

<  I  P{|X-y|  >  -tA}  (by  (53)) 

k=1        "l\l 


n  eB 

k 


II  ers 

^  ^n^l  >  2M|a"|^  ^  °^^^  ^^y  hypothesis).  D 
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Lemma  2.13.   If  P{|xj  >  t}  is  regularly  varying  with  exponent  -2, 
then  p{|y|  >  t}  is  likewise  regularly  varying  with  exponent  -2. 

Proof.   Let  L(t)  =  t^P{|x|  >  t}  and  L^(t)  =  t^P{|Y|  >  t}, 

for  t  >_  0.   It  need  only  be  shown  that  L  (t)  -  L(t)  since  then,  for 

arbitrary  s  >  0, 


L^(st)  -  L(st)  ~  L(t)  -  L  (t), 


To  this  end,   let  0  <   e  <    1    be  arbitrary  and  let   t  >    (l+e)|y|/£ 
where  u  =   EX.     Then 


TTI  <   ^^^        a"d       ^  >   y-t 


whence 


V^  .    t'pllYl    >    t[    ^    P||X-u|    >   t] 


^^^^  ' t^Piixi  > t}"  pii^r>^i 


P{X   <    M-t|    +   pIx   >    M+tl 

-  Pl|x|  >\\ 


^  P||x|   >  t\ 


^^1^1  ''^  t2pl|x|>t} 
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(l+e)\(T^) 


since,  by  hypothesis,  L  is  slowly  varying. 

L/t)        2 
Hence  llm  sup   .  v  _<  (1+c)  ,  and  since  e  is  arbitrary  we 
t->-<» 
obtain 


L^(t) 
lim  sup  , ,^ ,  <  1 


t^o 


L(t) 


(54) 


Again,  let  0  <  e  <  1  be  arbitrary,  and  now  let 
t  >  (1-e)|u|/e,  which  implies  that 


:; —  >  u+t   and   -; —  <  u-t. 
1  -e  1-e 


Therefore 


bill      p{|x-m|   >  t] 

L(t)  P||X|    >    t} 


P{X    <    M-t}    +    P{X   >    M+t 

--     P{|x|  >  t\ 

P{X  <  ^}  .  Plx  >  ^i 


"pTfxr>Tr 


P{|X|    >^}         n-e)2(^)2p||x|    >   ^} 
P{|x|    >  t}     ~ 


t   P      X      >    t 


il8 


(1-e)\(^) 

ruf-=  (1-e)2(Uo(1)) 


since  L  IS  slowly  varying.   Hence  lim  inf   .  .  >  (1-e)  , 
whence 


L^(t) 
lim  inf   ,  .  >_   1 


This,  together  with  (54),  shows  that  L  (t)  -  L(t)  which  is  tantamount 

to  p{|y|  >  t}  regularly  varying  with  exponent  -2.  Q 

We  are  now  able  to  state  and  prove  a  CLT  for  random  variables 
centered  about  their  mean. 

Theorem  2.5.   Let  {x,  X  ,  n  ^  I  }  be  i.i.d.  random  variables  with 
EX  =  «>  and  let  P{|x|  >  t}  be  regularly  varying  with  exponent  -2. 

Let  la  ,  n  >  1  }  be  constants  with 

n    —     ' 


B  B 

G( — : — T — r)  ~  G( J — r)  (55) 

min  |a  I       max  [aj 

1<k<n         Kk<n 


and 


n 

Z   P{|X|  >  gB  /|a  |}  =  0(1)   for  all  e  >  0.  (56) 

k  =  1         "  ^ 


Then 


n 

E  a,  (X,  -EX)  ^ 
k=i  k  k     d 

^^-^— 3 ^  N(0,1) 

n 
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Proof.  Via  Lemma  2.6  and  regular  variation  of  P{|x|  >  t},  we  can 

conclude  that  G  and  H  are  slowly  varying.  This,  in  turn,  implies 

that  X  e  d^    by  Lemma  2.3.   Let  Y  =  X-EX,  Y  =  X  -EX,  n  >  1  , 
I  n    n      — 

2  2 

and  note  that  since  EX  =  »  we  also  have  EY  =  «. 

Now  by  Lemma  2.13  and  the  hypothesis  that  P{|x|  >  t|  is 

regularly  varying  with  exponent  -2,  we  see  that  p||y|  >  t}  is  also 

regularly  varying  with  exponent  -2.  Again  by  Lemma  2.6  we  can 

conclude  that  G  and  H  are  also  slowly  varying.   Next,  via  Lemma 

2.10,  we  conclude  that  B  ~  B  .   Now  (55)  is  equivalent  to 

n    n 

*  * 

G  (B  /  min  |a  | )  ~  G  (B  /  max  la  I)  by  Lemma  2.11.   Finally  we  note 

Kk<n  ^S.^SP 

by  Lemma  2.12  that  (56)  implies  Z  p(|y|  >  eB  /|a  |}  =  o(1)  for  all 

1<  =  1         "  ^ 
e  >  0.  Therefore,  all  the  hypotheses  of  Corollary  2.1  are  satisfied 

for  the  sequence  {y,  Y  ,  n  _>  1  }  •  Hence 


n 

^^ -y   N(0,1) 

B 
n 


* 

Then  remembering  that  B  -  B  , 

n    n 


n  n 

I  a,  (X,  -EX)     *        Z  a,  Y,   ^ 

,  _i  k  k       B   ,  ,  k  k  d 

^^^-B (f)(^'^    ,      )  -   N(0,1).  D 

n         n     B 

n 
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2.5  Asymptotic  Negligibility 

In  order  to  establish  a  CLT,  "it  is  [generally]  essential  to 

n 

impose  a  hypothesis  where  individual  terms  in  the  sum  S  =  Z  a  X 

n   ,  ,  k  k 
k  =  1 

are  'negligible'  in  comparison  with  the  sum  itself"  (Chung,  197^, 

p.  197).  There  are  several  different  measures  of  negligibility.  The 

literature  (Loeve,  1977,  p.  302;  Laha  and  Rohatgi,  1979,  p.  295) 

calls  the  double  array  la,  X,  /B  ,  1  <  k  <  n,  n  >  1  I  uniformly 

k  k  n    -   -     - 

asymptotically  negligible  ( u . a . n  . )  if 


a  X 
lim  max  P||^ — |  >  e}  =  0   for  all  e  >  0. 
n->-«>  1<k<n      n 


This  condition  is  also  known  by  various  other  names,  such  as 
infinitesimal  (Chow  and  Teicher,  1978,  p.  422)  or  holospoudic  (Chung, 
1974,  p.  198). 

Another  measure  of  negligibility  is 


\^k  , 

lim  max   median(— r — )  =  0.  (57) 

n^"  1<k<n         n 


Fact.  If  la,  X, /B  ,  1  <  k  <  n,  n  >  1  }  is  u.a.n.,  then  (57)  holds, 
'  k  k  n    -   -     - 


Proof.   Let  e  >  0.   By  hypothesis,  there  exists  an  integer  N  such 
that  if  n  >  N 


a  X 
Pil-g-^l  >  e}  <  -^   for  all  k  =  1,  .  .  .  ,n, 
n 


whence  (57)  is  established.  Q 
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The  measure  of  negligibility  that  we  are  using  in  our  CLTs  is 
the  condition  (10).  Under  our  hypotheses,  it  is  equivalent  to 


max  — >  0.  (58) 

1<k<n    n 


Fact..   If  {x^,  n  >   ^}   are  i.i.d.  random  variables,  then  (10)  and  (58) 
are  equivalent. 


Proof.   Let  £  >  0  and  define  p  ,  =  pfla  X  I  >  ^B  I, 
nk    ' '  k  k'     n 

1    <   k  <  n,   n  >   1 .      Thus, 


Pi                ''k'^'    s      1 
Pi   max     — >   ej 

1<k<n         n 


=   P{U[|a,Xj    >.B^]} 


=    l-P{nU\\|    <    cB^]} 

n 
k=1         ^  ^  " 


=   1-   n  [1-P(|a  X    I    >   eB    }] 
k  =  l  ^  ^  " 


=  1-  n  (i-p  ,  ). 
k=i        "^ 

n 
Hence  (58)  holds  if  1-  n  (1-p   )  =  o(1).  Recalling  the  elementary 

k  =  1    ""^ 

inequality  i-x  <  e"'^, 


n         n 

0  <  1-exp{-  Z   p  }  =  1-  n  exp{-p  } 


n 


n 


<  1-  n  (i-p  ,  )  <  z  p  ,  . 
-  k=i   ""^  -  k=i  "^ 


Thus,  1-  n  (1-p,.i^)  =  0(1)  iff  I  p   =  0(1).  Therefore  (58)  is 

k=1  k=1  " 
equivalent  to  (10).  Q 

Our  measure  of  smallness  (10)  implies  the  u.a.n.  condition. 
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Fact.   If  (10)  holds,  then  {a  X  /B  ,  1  <  k  <  n,  n  >  1 }  is  u.a.n 


k  k  n' 


Proof.   Let  e  >  0.   Clearly,  f or  all  k  =  1 ,  .  .  .  ,n 


1<j<n  -^  ^ 


Thus 


max  P{  la,  X,  I  >  eB  } 
1<k<n 


<  Pi  max  la.X. I  >  eB  1  =  o(1 
-   l<j<n  J  J 


(by  (10)).  n 


2.6  An  Asymptotic  Representation  for  (b^,  n  >  1  } 
The  CLTs  in  this  chapter  hinge  upon  hypotheses  that  involve  func- 
tions of  regular  variation.   At  first  we  assume  that  (8)  holds;  later 
we  suppose  that  P{|x|  >  t}  is  a  regularly  varying  function.   In  either 
case  G  and  H  are  slowly  varying.   We  have  seen  via  Lemma  2.3  that  the 
random  variable  X  is  in  g^  for  all  0  <  p  <  2,  but  EX  ^=  °= 
is  the  case  of  greatest  interest  to  us.   It  is  natural  to  ask  which 
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random  variables  have  a  distribution  which  satisfies  these 
hypotheses.  To  understand  this  class  of  random  variables  one  needs 
to  study  the  behavior  of  regularly  varying  functions.  We  know,  by 
the  Karamata  Representation  Theorem  (46),  that  all  slowly  varying 
functions  are  of  a  specific  form.   Also,  recall  that  a  function  W(t) 
is  regularly  varying  with  exponent  p  (-»  <  p  <  ■»)  if  and  only  if 
W(t)  =  t  L(t)  where  L(t)  is  a  slowly  varying  function.  With  all  this 

in  mind  we  will  now  generate  an  interesting  class  of  slowly  varying 

2 
functions  which  are  applicable  to  our  CLTs  with  EX  =  ». 

Suppose  the  distribution  of  the  random  variable  X  satisfies  for 

some  0  <  a  <  1 


P{|X|  >  t}  -  «exp{(10g  t)"}    ^3  ,_, 

2t^(log  t)'  ^ 


Thus 


n(    \        (     aexpjdog  t)  }  ..      r,,     ,ai 
G(x)  ~  J  ^^-^ —  Tr~^^^   ~   expjdog  x)  }, 


e   tdog  t)^"" 


One  can  check  that  this  is  a  slowly  varying  function  by  observing 
that,  for  3  >  0,  G(sx)  -  G(x)  as  x  ->■  «>.   Alternatively,  one  can 
easily  verify  that  (46)  holds.   For  let  a(t)  =  1  and 
e(t)  =  adog  t)"'^  .  Then 


,t   ,,     ,a-1  log  t 

f  f  adog  s)    ,1      r  f       a-1  ,  1 
expij  — ^^ — ^ — ds|  =  expjj      au   du| 

1       ^  0 


=  expldog  t)"}  -  G(t). 
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We  require  that  a  <  1  so  that  e(t)  -»•  0  and  we  also  need  a  >  0  to 
ensure  that  G(t)  ->■  ». 

From  (13)  we  obtain  q  =  /n/G(q  ).  Since  G  is  slowly  varying,  a 
natural  question  is  whether  we  can  replace  G(q  )  by  G(/n)  and  thus 
conclude  that 


q   -  /n/G(/n)  (59) 

n  ' 


thereby  yielding,  via  (7),  an  explicit  asymptotic  representation  for 

{b  ,  n  >  1 }. 
n    -  ' 

Define  G^(x)  =  exp{(log  x)°'},  0  <  a  <  1.  This  class  of  slowly 
varying  functions  has  some  intriguing  properties.   It  will  be  seen 
that  (59)  holds  for  some,  but  not  all,  a  in  (0,1). 


Proposition  2.1  .   If  G  (x)  =  exp{(log  x)"},  then 


for  0  <  a  <  1/2, 
lim  — ^— -  =    <  e  for  a  =  1/2, 


n^oo  r-   /'  ,  /- 

•n/G  (/n 


a        ) 


for  1/2  <  a  <  1 


Proof.  We  need  to  observe  the  limiting  behavior  of 

(log  q  )°'  -  (log  /n)°'.   From  (13)  we  see  that  q  =  /n/G  ( q  ) , 
n  nan 

whence 
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log  q  =  log  /n  +  -log  G  (q  ) 
n  2  a     n 


log  /n  +  -(log  q^)*^.  (60) 


Let  m  =  log  /n  and  note  that  for  all  large  n,  q  >  /n.   Hence  from 


n  - 


(60),  if  n  is  sufficiently  large, 


(log  q^)^  -    (log  /n)"  =    (log  /n  +  l(log  q^)"*)"  -    (log  /n)" 


>    (log  /JT  +  i(log  /^ff  -    (log  /n)" 


/      ,    1    a, a  a 

(m  +   ^m    )      ~  "1 


a-1  ,1    a, 
=   ax        (:5m   ) 
m       2 


by   the  mean  value  theorem  for  some  x     where  m  <   x     <  m  +  -m°', 

m  —     m  —  2' 

Therefore 


(log  q^)^  -    (log  /n)"  >  |(m  +  Im°')°'-^m°' 


(Uo(1))fm°'-^m°'  =    (Uod))!™^"-^ 


Hence 


lira  inf    Idog  q   )°'  -    (log  /n)"}    >  |  lim  m^°'"\  (61) 
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Since  G  is  slowly  varying  we  obtain  by  (3)  for  all  0  <  e  <  1 

that  G(x)  <  X   for  all  large  x.  Then  q  =  nG(q  )  <  nq  ^ ,  which 
-  ^n      ^n  -  ^n 

shows  that  q  <  n      for  all  0  <  e  <  1  and  large  n.  So  for 
n  -  ° 

8  /2 
arbitrary  6  >  1  and  all  large  n,  q  £  n   .  Therefore,  recalling 

(60),  if  n  is  sufficiently  large 


(log  q^)-'  -  (log  /nr   =  (log  /n  +  ^(log  q„)  )  "  (log  /n)' 


<  (log  A  +  i(log  n^/2)<')°'  -  (log  ^)°' 


=  (log  /H  +  |-(log  /n)")"  -  (log  /n)" 


=  (m  +  p-m  )  -  m 


=  ax^   (•^)m 
m   2 


,01 


by  the  mean  value  theorem  for  some  x  where  m  <  x  <  m  +  ■^— m"*. 

m  —     m  —  2 

Thus, 


(log  q^)      -    (log  /n)      <  am        (^)m     =  -6  m 


This,    in  turn,   yields  for   all   6   >   1    that 
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Urn  sup{(log  q^)"  -  (log  /n)°'}  <  |8'^lim  m^°'"^ 


Letting  6  +  i  we  obtain 


lim  supjdog  q  )°'  -  (log  /n)"*}  <  |  lim  m' 


2a-1 

I  n 


This   together  with   (61)   yields 


limfdog  q^)"  -    (log  /n)"}   =  |  lim  m^°'"^ 


I  for  0  <  a  <   1/2, 

1/4  for   a   =   1/2, 

for    1 /2   <   a   <   1 . 


Therefore 


q„                       /n/G    (q    )  G    (q    )    1/2 

lim  -^^—  =   lim  ^^^  =  lim(^^^) 


lim(exp{(log  q^)"  -    (log  /n)"})^^^ 
n-»-oo 


for   0   <   a   <    1/2, 

for   a  =   1/2, 

f or    1 /2   <   a   <    1  .      D 
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Remark.  In  this  last  example  we  let  G  (x)  =  exp{(log  x)"}  but  if  we 

let  G  (x)  -  G  (x),  the  conclusion  of  Proposition  2.1  will  now  be 

shown  to  be  valid  for  G  . 

a 

Proof.   Let  G  (x)  =  exp{(log  x)"},  0  <  a  <  1 ,  and  let  G  (x)  be  some 
a  a 

function  defined  by  (5)  with  G  (x)  ■-  G  (x).  Define  Q  (x)  =  x^/G  (x), 

a       a  a         a 

Q^(x)  =  x  /G^(x),  q^(x)  =  Q~^x),  and  q  (x)  =  Q~\x).  Since 
Qq((x)  -  Q^(x)we  have  Q^(q^(t))  =  t  =  Q^(Q^(t))  -  '^J^J^^^'    whence 


'^J'^a^^^^    ~  V^J^^^'  (62) 


Utilizing  Lemma  2.7  with  Q^(x)  =  x^L(x)  (where  L(x)  =  1 /G  (x)),  we 

-1  /2 
see  that  y    ^'^V'^   ^^   slowly  varying.   Applying  this  to  (62)  we 

obtain,  via  Lemma  2.9,  that 


CQ^(q^(t))]-^/2  .  q^(Q^(q^(t)))  -  [Q„(5„(t) ) l"^ ^^  •  q,(Q^(q,(t) ) ) . 


Reapplying   (62)   we   can  conclude  that  q    (t)    -  q    (t).      This,    together 

with  G   (x)    ~  G   (x),   shows  that 
a  a 


lim  (where  q     =  q    (n)) 


"^"  /n^(/H) 


n         a 


1  for   0   <   a   <    1/2, 


^'n  j     1  /8 


lim  ZmH  "  \  ®  for  a  =  1/2, 

"""  /h/g  (/H) 


f  or    1  /2   <   a   <    1  .   D 
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In  view  of  (13)  and  the  example  in  Proposition  2.1,  an 
interesting  question  to  raise  is  whether  (59)  prevails  for  a  large 
class  of  distributions.  The  answer  is  affirmative  in  view  of  the 
ensuing  Propositions  2.2  and  2.3. 


Proposition  2.2.   If  G(x)  ^  »,  then  G(q  )  -  G(v^)  iff 
n 


G(x)  -  G(x/G(x)).  These,  in  turn,  are  equivalent  to  (59).   In  such  a 
case,  G  is  necessarily  slowly  varying. 


Proof.   Recall  that  q  =  /n/G(q  ),  whence  v^  <  q  for  n  sufficiently 
n        n  —  n  ■' 

large.  Assuming  that  G(q  )  -  G(/n)  and  utilizing  the  fact  that  G  is 
nondecreasing  we  obtain  for  n  sufficiently  large  that 


G(yn)  <  G(/nvWH))  <  G(/n/G(q  )) 


G(q^)  =  (1+o(1))G(/n). 


Thus  G(y^)  ~  (/n/G(/n)).  Now  to  show  G(x)  -  G(x/G(x)),  apply 
Lemma  2.9  twice.   First  we  obtain  G(v^)  -  G(/n+1 )  and  then 
G(/n/}(/n))  -  G(/rviT/G(/nTT)).  Hence,  if  /n  <  x  <  /n+T  we  have 


G(/n)  <  G(x)  <  GCx/GOTT)  <  G(»/n^vWn^)) 


(1+o(1))G(/n/G(/n))  =  ( 1 +o( 1 ) )G(/n) 


thereby  proving  the  necessity  portion. 
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Next,  we  prove  the  sufficiency  half  of  this  proposition.  Again 


we  use  Lemma  2.9.   By  assumption  G(x)  -  G(x/g(x))  implying  that 


x/G(x) 

X —  ■*     00, 


Thus,  by  Lemma  2.9 


G(x)  -  G(-^^^^^^;^^) 


Kx/G(7)) 


Therefore 


x/crxT 


G(x/GUy)  ~  G(— £zz=ll) 
^(x/G(iT)" 


whence  replacing  x/G(x)  with  q  yields 


^n 

G(q^)  -  G(      )  =  G(/n)         (by  (13)). 

/G(q^) 

Finally,  we  will  show  that  G  is  slowly  varying.   If  s  2  1  .  then 
for  sufficiently  large  x 


G(x)  <  G(sx)  <  G(x/G(x)) 

which,  together  with  G(x)  -  G(x/G(x)) ,  shows  that  G(x)  ~  G(sx) 
If  0  <  s  <  1 ,  then  by  the  part  already  proved 


G(x)  =  G(-(sx))  -  G(sx). 
s 
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Thus  G(sx)  -  G(x)  as  X  ^  »  for  all  s  >  0  and  so  G  is  slowly 
varying.  □ 

With  Proposition  2.2  in  mind  we  would  like  to  find  other 


conditions  that  imply  (59)  or,  equivalently ,  G(x)  ~  G(x/G(x)). 
Before  we  do  so,  we  need  to  state  a  definition  and  prove  a 
preliminary  lemma.  We  say  that  a  nonnegative  function  g,  defined  on 
[0,"),  preserves  asymptotic  equivalence  at  infinity  if 
g(x^)  -  S(y^)  whenever  jx^,  n  >  1 }  and  {y  ,  n  >  1 }  are  nonnegative 
sequences  with  ^^^  ~  y„  "*■  "•  We  have  already  noted,  in  Lemma  2.9, 
that  if  L  is  slowly  varying  and  a(t)  -  b(t)  ->■   »,  then 
L(a(t))  -  L(b(t)).  We  now  establish  the  following  lemma. 

Lemma  2.14.   Let  g  be  a  nonnegative,  nondecreasing  function  defined 
on  [0,")  which  preserves  asymptotic  equivalence  at  infinity.  Let  g 
defined  on  [0,«>)  agree  with  g  on  the  integers  and  be  defined  by 
linear  interpolation  between  the  integers,  i.e., 

g(x)  =  (g(n+1 )-g(n))(x-n)  +  g(n)  f or  n  <  x  <  n+1 ,  n  >  0.      (63) 

Then  g(x)  -  g(x)  as  x  ^  »  and  g  preserves  asymptotic  equivalence  at 
infinity. 

Proof.  For  all  large  x,  writing  n  _<  x  <  n+1  ,  it  follows  from  the 
hypotheses  on  g  that 
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uo(i)  <  -f^  =  4^  <  ^H  <  ~^¥^  =  ^W 

-g(n+1)        g(n+l)   -  g(x)   -     gin)  g(n) 


=   1+o(1 )  as  X  -»•  ", 


whence  g(x)  -  g(x)  as  x  ->■   ".   Then  if  x  -  y 

n   ■'n 


g(x^)  ~  g(Xj^)  -  g(y^)  ~  g(y^) 


and  so  g  preserves  asymptotic  equivalence  at  infinity. Q 

The  next  proposition,  when  combined  with  Proposition  2.2,  (7), 
and  (13)  yields  the  explicit  asymptotic  representation 


B  -  3  /g(*^). 
n    n 


Proposition  2.3.  Let  G  be  defined  as  in  (5)  and  suppose  that 
G(x)  ->■  CO.  Then  (i)  =>  (ii)  =>  (ill)  =>  G(x)  -  G(x/gTxT)  (or. 


y/ci 


equivalently,  B^  -  s^/G(/n))  where  (i),  (ii),  (iii)  are  given  by; 


(i)  there  exists  0  <  t(x)  +,  0  <  b(x)  +  such  that 

log2X 


G(x)  - 


b(x) 


(ii)  G(u  )  -  G(v  )  whenever  {u  ,  n  _>  1  }  and  (v  ,  n  >  1  }  are  real 


sequences  with  log  u  ~  log  v  ■*  a>- 

(iii)  there  exists  r(x)  +  «>,  3(x)  t  such  that 


/log  Xi 

G(x) ^    ' — 

^^^^  six) 
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Moreover,  G(x)  -  G(x/G(x))  implies  that  G  is  slowly  varyi 


ng. 


Proof.   Suppose  that  (i)  holds  and  let  log  u  -  log  v  •>  <».  Set 
n       n 

m  =  minju  ,v  },  M  =  maxlu  ,v  },  n  >  1.  Then 
n      '  n  n'   n      ^  n  n     - 


G(M  )          b(ra  )    log^M    log^m 
1  .  n    f.^    ,.s^ n    f    2  n      2  ni 


log  M  -  log  m 
<  (Uo(l))exp( ^  ;,   ,   ^  "} 


log  M 

=  (l+o(1))exp{0(1)log(^ -)\ 

°  n 


log  u 

(1+o(l))exp{0(1)|log(^ -) 

'     log  V 
°  n 


=  1+0(1) 


implying  that  G(m  )  -  G(M  ).  Therefore, 


G(m  )   G(u  )   G(M  ) 

^^°^^^  =Gof)<Gor)  <Gaf)  =  ^*°(^) 

n      n      n 


thereby  proving  (i)  =>  (ii). 

Next  suppose  that  (ii)  holds.   It  will  be  shown  that  (iii) 
obtains  with  r(x)  =  (log  x)   .  Define  g(x)  =  G(exp{x  }),  x  >  0. 
We  will  now  verify  that  g  preserves  asymptotic  equivalence  at 

infinity.  Let  x  ~  y  ^  «  and  set  u  =  explx  },  v  =  exp  y   , 
n    n  n      ^nn      'n' 

4    4 
n  _>  1  •  Then  log  u  =  x  ~  y  =  log  v  -»  "  implying  via  (ii)  that 
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;(x^)  =  g((log  u)'^^'^)   =  G(u  )  -  G(v  ) 
n  n         n      n 


1  /4 
g((log  v^)   )  =  g(y^) 


Define  g  on  [0,«>)  as  in  (63).   By  Lemma  2.^^,   g(x)  -  g(x)  and  g 
preserves  asymptotic  equivalence  at  infinity.  Thus, 


ixpjdog  x)        I   ^   expj  (log  x)        } 

gHH         .,^    ,1/4, 
g((log  x)    ) 

expfdog  x)    } 
g((log  x)    ) 


and  to  complete  the  proof  it  suffices  to  show  that  e^/g(x)  is 
eventually  nondecreasing.  To  this  end,  observe  that  it  suffices  to 
show  for  n  sufficiently  large  and  0  <_  t  <  t  <  1  that 

n+t^      n+t,| 

1^ >  r^ .  (64) 


g(n+t2)   sin+t^) 

Choose  N  such  that  g(n+1)/g(n)  <_  2  for  all  n  >^  N.   For 
n  >  N  and  0  <  t  <  1 ,  set 


n+t 
A^(t)  =  -^— 


g(n+t) 


For  0  <   t^    <   t^  <    1 ,    A^  is  differentiable  on   (t^  ,t    )    and  is  right   and 
left  continuous  at   t    ,    t    ,   respectively.      Now  on   (t    ,t    ), 


65 


^,fy^       g(n+t)  e    -  e    g'(n+t) 
A'Ct;  =  5 

"  [g(n+t)]^ 


n+t 
®      [g(n+t)  -  (g(n+l)  -  g(n))] 


Cg(n+t)]^ 


n+t    _ 
^      [g(n+t)  -  g(n+l)  +  g(n)] 


[g(n+t)]^ 


n+t 

>  — ^ ^C2g(n)  -  g(n+1)]  >  0 

[g(n+t)]^ 


recalling  the  choice  of  N.   The  mean  value  theorem  guarantees  the 

existence  of  a  point  0  in  (t,  ,t„)  such  that 

n      12 


A^(t„)  -  A(t.)  =  A'(0^)(t  -t,). 
n  2      I     n  n   2  I 


However  t^  >  t,  and  A'(t)  >  0,  whence  A  (t„)  >  A  (t.)  thereby  proving 
2  n    —  n  2  —  n  1 

(64). 

Now,  suppose  that  (iii)  holds.  Then 


^  ^  G(x/G(xT)  __    (T,,(,))    sM_     ^^p|/log(x/G(x))  _  /loOj 
^^^'  s(x/G(x))       r(x/G(x))     ^^^' 


X  /i    /1^^     [/lOg(x/G(x))  -  /log  X^  ,.^, 

<  (l+o(l))expl ^ ^^^ }.  (o5) 


But 
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log(x/G(x))    =  log  X   +  -log  G(x) 


1  V lOR    X 

log  X  +  -d+od  ))(   ^,^. log  s(x))  (by  Lemma  2.9) 


Clog  x][U  l(Uo(1))( '- i°f^iiil)] 


2  /  ,  /:; log  x 

r(x)/log  x       ^ 

implying  for  all  large  x  that 


/og(x/G(x))  =  /log  x[l+  l(Uo(l))( ^ -  1°S  s(x)^1/2 

2  ,  .  ,:; log  X 

r(x)/log  X 

</l3i^(1+  J log  s(x)^1/2         (since  G(x)  ->  CO) 

r(x)/l5^     ^°S  ^ 


<  /log  x(l+  ^     +    ''   )^^^  (since  0  <  s(x)  +) 

r(x)/log  X   /log  x 

1         1 


<  /log  x(l+  "ZZIII  "^       ) 

r(x)/log  X   /log  X 

=  /log  X  +  — 7— r-  +  1  <_  /log  X  +  2  (since  r(x)  t  =») 


Hence  for  all  large  x , 


/log(x 


log(x/G(x))  -  /log  X  <  2. 


Then,   from   (65),   for  all  large  x 
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,  ^  G(x/G(x))  ^  .^   ,_,    r  2   , 
^  ^   G(x)    ^  (1-0(1  ))exp|:^:(3^} 


1+0(1))  (since  r(x)  +  ■») 


thereby  proving  G(x)  -  G(x/G(x) ). 

Finally,  the  last  assertion  was  proved  in  Proposition  2.2.  Q 

2.7  Examples 
We  conclude  this  chapter  with  two  examples  illustrating  some  of 
the  results  of  the  chapter. 


Example  2.1  .   Let  {x,  X^,  n  >  1  }  be  i.i.d.  random  variables  with 
common  density  function 


f2x  ^  f or  x  >  1  , 

0  f  or  X  <  1  . 

Then 


I  »a^gl<(X  -2)  ^ 

^-^ ^  N(0.1). 

/nlog  n 


2 
Proof.   Note  that  EX  =  2  and  EX  =  ».   Also,  for  x  >  1, 


P{|X|  >  x}  =  J  2t"^dt  =  x"^.  (66) 
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Thus,  P{|x|  >  x}  is  regularly  varying  with  exponent  -2.  Then,  for 
X  >  1  , 


G(x)  =  /  2tP{|x|  >  t}dt 
0 


1         X 

/  2tdt  +  J  2t~  dt 


1 


=  1  +  21og  X 


which  is  a  slowly  varying  function. 


Set  a  =  /log  n,  n  >  1 .   Then 


n        .n  n 


s  =  E  log  k  ~  J  (log  x)dx  -  J  (1+log  x)dx 


k=l         1  1 


=  nlog  n. 


Note,  that  condition  (ii)  of  Proposition  2.3  is  satisfied,  whence 


/G(/n)  ~  /nlog  n, 


B  -  s  /G(/n)  ~  /nlog 
n    n 


Next  observe  that  min  |a  |  =1  and  max  |a  |  =  /log  n.  Set, 

1<k<n  1<k<n 


for  n  >  1 , 


B 

a  =  — : 1 r  ~  /nlog  n 

n    mm  |a  | 

1<k<n 
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and 

B 

6     =  1 r  -  /nlog  n. 

n         max    |a    | 

1<l«n 


Thus,   recalling  Lemma  2.9, 


G(6    )    <  G(a   )    =   (1+0(1 ))G(/nlog  n) 
n     -         n 


(l+o(1))log  n  =   (1+0(1 ))G(/nlog  n)    =   (1+o(1))G(e   ) 


and  so  G(B  )  -  G(a  )  establishing  (55). 
n      n 

Finally,   let  e   >   0.      For   n  sufficiently  large 


n 

E   P{|X|    >   eB   /|a    1} 
k  =  1  "        ^ 

<     Z  P{|X|  >  s/^2§^]  (Since  B  -  /^log  n) 

k=1        2/log  k  " 

_       ^    ^^lOg  k   ^  (^y  (gg)) 

k=1  e  n(log  n) 


<  _MogJL_  =  _JL_  =  0(1) 
e  n(log  n)    e  log  n 


establishing   (56).     Then  by  Theorem  2.5, 


Z   /log   1<(X  -2) 

k  =  l 

iLJ _ .  N(0,1) 

n 


Since  B  -  /nlog  n,  the  desired  result  follows.  Q 
n 
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This  next  example  illustrates  Corollary  2.1.   It  will  also 

create  a  family  of  CLTs,  since  the  weights  (a  ,  n  >  1 }  are  not 

n    —     ' 

explicitly  defined. 


Example  2.2.   Let  {x,   X    ,   n   >   ^}   he   i.i.d.  random  variables  with 
common  density  function 


ef^2(lo£_lxLM)  ,,,  |,|  >  ,^ 

f(x)  = 

for  |x|  <  e, 

Let  L  be  any  positive  slowly  varying  and  nondecreasing  function, 
Then 


n 

I  L(k)X, 

k-1  "        "^ 

^    ^  N(0,1) 


e/nL(n)log  /n 

Proof.   Firstly,  via  integration  by  parts,  we  verify  that  f  is  indeed 
a  density.  For 


I  f(x)dx  =  e^l     i^i2SJL)lldx 
-<"  e    X 


CO         00 


e^[(2(log  x)-l)(-  ^x  ")|   +  J  x'^dx] 


2 

e    e 


2.1  -2    1  -2 
e  L-e   +  -e  1=1 
2      2^  -^    ' 


71 


Clearly  EX  =  0  and  EX  =  ».   For  x  >  e , 


P{|X|  >  x}  -e^j   (iOog^jdt 
X     t^ 


00         00 

[(2(log  t)-1)(-  jt~^)\      +  /  t'^dt] 

X     X 


(-)  log  X 


and  so  P{|x|  >  x}  is  regularly  varying  with  exponent  -2.   For 
X  >  e, 


e       X 
G(x)  =  J  2tdt  +  /  2t(f)^(log  t)dt 
0       e   ^ 


(elog  x) 


which  is  slowly  varying.  Note  that  since  L  is  slowly  varying,  it 
follows  that  (see,  e.g..  Feller,  1971,  p.  281) 


2    "  2    "  2        2 
^n  =  ^  ^L-  =  I  L  (k)  ~  nL  (n) 
k=1  ^       k=l 


Also, 


G(x/G(x))    =   G(xelog   x)    =   e(log(xelog  x))' 


2  2 

-  e    (log  x)      =  G(x) 
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Then  by  Proposition  2.2  or  2.3 


vx;(/n)  -  e/nL(n)log  /n. 


B  -  s  /G(/n)  -  e/nL(n)log 
n    n 


Let  e  >  0  and  note  that  if  n  is  sufficiently  large 
B  >  /nL(n)log  /n.     Hence  for  all  large  n 


n  n 

Z  P{|X|  >  £B  /|a  1}  =   Z  P{|X|  >  eB  /LCk) 
k  =  1  "   '^     k  =  l  " 


n 

<      Z  P|ix|    >  eB   /L(n)}  (since  L(x)    O 

1<=1  " 


<   nP(|x|    >  e/nlog  v^} 


2 

log(e/nlog  /n)    =  o(1 ) 


E  ndog  /n) 


whence    (10)   obtains.      It  remains   to  show  that    (9)   holds. 

Note  that     min    |a    |    =  L(l)   and     max    |a    |    =  L(n).     Since  G  is 
1<k<n     ^  l<k<n     ^ 

slowly  varying  and  B^   -  e/nL(n)log  /n,   Lemma  2.9  yields 


G(B/min    |a,|)    -  G(^^^^^^i^) 
"  1<k<n     ^  ^^^' 


G(/nL(n)log  n) 


and 
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G(B^/rnax    |aj)    ~  oi'-^^^^^) 
"  1<k<n     ^  ^^"^ 


G(/nlog  n) . 


Let  a^  =  y^L(n)log  n,   n   >   1,    and   6     =  v^log  n,   n  >   1.      Tc 

establish   (9)   we  need  to  show  that  G(a  )    -  G(6   ).     Note  that 

n  n 


G(a^)    =  e^(log(/nL(n)log  n))^ 


2   1  2 

e   (2(log  n)+(log  L(n))+log2n) 


e   (2log  n)  (by    (3)) 


and 


G(6^)    =  e^(log(/nlog  n))^ 


2  1  2 

e   (^(log  n)+log  n) 


e   (^log  n) 


and  so   (9)   obtains.      Then,    via  Corollary   2.1, 


n  n 

Z  L(k)X,  I  L(k)X, 

k=1  ^  k-1  ^  ^ 


e/nL(n)log  v^        (1+o(1))B 

n 


CHAPTER  THREE 
GENERALIZED  STRONG  LAWS  OF  LARGE  NUMBERS 


3. 1   Introduction 
In  this  chapter,  we  present  generalized  strong  laws  of  large 
number  (GSLLN)  for  weighted  sums  of  random  variables,  i.e.. 


5 ^  0   a.s.  (1) 

n 


The  hypotheses  of  these  theorems  vary  greatly.   In  general,  we 
control  the  behavior  of  the  random  variables  {x  ,  n  >  1  }  by 
restricting  the  magnitude  of  the  tail  of  the  distribution  of  |x  | . 
Most  of  the  assumptions  that  involve  the  sequences  {a  ,  n  >  1 }  and 
jb^,  n  2  l}  only  depend  on  the  absolute  value  of  their  ratio.   It 
thus  proves  convenient  to  define  the  sequence  (c  ,  n  2  1 }  by 


n' 


°n  =  Vl^nl'   ">^-  (2) 


This  notation  will  be  used  throughout  this  chapter. 

The  sequence  (y^,  n  >  i}  will,  for  the  most  part,  be  the  null 
sequence.   In  the  remaining  cases,  (y  ,  n  >  1 }  will  be  a  sequence  of 
conditional  or  unconditional  expectations. 
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3.2  Preliminary  Lemmas 
The  theorems  In  this  chapter  assume  that  the  random  variables 
{x^,  n  >  1}  are  either  i.i.d.  or  stochastically  dominated.  We  say 
that  the  sequence  { |x^|  ,  n  >  1 }  is  stochastically  dominated  by  |xj  if 
there  exists  a  constant  D  <  »  such  that 

P{|X^|  >  t}  <  DP{|X|  >  t/D}     t  >  0,  n  >  1.  (3) 

It  is  important  to  note  that  condition  (3)  does  not  place  any 
restrictions  on  the  joint  distributions  of  the  random  variables 
{X^}.  Also  it  should  be  clear  that  if  D  satisfies  (3),  then  any 
number  larger  than  D  also  satisfies  (3).  Finally,  note  that  if  the 
random  variables  {x^,  n  >  1}  are  i.i.d.,  then  (3)  holds  with  X  =  X 
and  D  =  1 . 

Lemma  3. 1 .   Let  X^  and  X  be  random  variables  such  that  |X  |  is 

stochastically  dominated  by  |x|  in  the  sense  that  there  exists  a 

constant  D  <  «  such  that 
o 

P{|X^|    >   t}   <  D^P{|X|    >   t/D^}  for  all  t   >  0.  (H) 

Then  for   all  q   >  0  and  s  >_  0 
SIXJ'^KIXJ    <   s)    <    D^"^E|X|^I(|X|    <    s/D^)    -   D^s'^Pdxl    >    s/D^}. 
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Proof.  Note  that 


E|XJ^I(|XJ    <   s)    <    S^P{|XJ    >   s}    .   EIXJ'^KIXJ    <   s) 

s 

=  qj   t*^"  p1|x    I    >  tkt  (by  Lemma  2.1) 

0  ° 


<   qD   /   t''~V{|x|    >   t/D Jdt  (by    (4)) 

O     Q  o 


qD   /   t^'VfiD   Xl    >   tldt 
°  0  ° 


DqCs'^pIId^xI    >   s}    +   ElD^Xj'^KlD^xl    <   s)]      (by  Lemma  2.1) 
D   S^P{|X|    >   s/D    }   +   D^*^E|X|^I(|X|    <   s/D    ).    D 


0'    o 


Lemma  3.1  will  be  used  in  establishing  Lemma  3.2  which,  as  will 
become  apparent,  plays  a  major  role  in  this  chapter. 

Lemma  3.2.  Let  {x^,  n  _>  1  }  and  X  be  random  variables  such  that 
i|Xf^|.  n  >^  1  }  is  stochastically  dominated  by  |x|.  Let  jc  ,  n  _>  1  } 
be  constants  with  c  >  0,  where 


max  c^  E  —  =  0(n)     for  some  q  >  0  (5) 

1_<k£n  j=n  c  . 


and 


I  P{|X|  >  DC  }  <  00  (5) 
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where  D   is  as  in   (3).     Then  for  all   0   <  M  <   » 


l_ylv    lQi 


E     -E|XJ^I(|XJ    <Mc^)    <   ».  (7) 

K  —  I     G, 

k 


Proof.      Let  0  <  M  <  «,    let  D     =  max(D,/M},    d     =     max  c     for 

°  "   1<k<n  ^ 


es 


that  d  +  !» 
n 


n  >  1,  and  set  dg  =  0.  Note  that  c  _<  d  ,  n  >^  1 ,  and  (5)  ensur 

d         +     a>. 

n 
In  view  of    (5),    there  exists   a  constant  C  <  «  such  that 


d^  I     -^  <  Cn  for  all   n  >   1.  (8) 

j=n  c^ 


Note  that  D  <  D^  so  (3)  holds  with  D^  and  then 


E  -iE|xJ^I(|xJ  <MC^) 

K  —  I   C, 

k 


k 


<   Z  ^[D^^^EIXI'^KIXI  <  D^c,)  .  of  ^^C^^P{|X|  >  D^c,}] 

K  —  I  C, 

k 


2 

(by  Lemma  3-1  with  s  =  D  c  "> 

0  k' 


dI''    I     4e|x|^I(|x|    <   DC    )    .    D^-^*^    ZP{|X|    >    DC    }.  (9) 

k  =  1    c^^  -     °  X  °       k  =  i  Ok 
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The  series  in  the  second  term  of  (9)  converges  since  it  is 
bounded  above  by 


D^"^*^  E  P{|X|  >  DC  }  <  00         (by  (6)) 
k=1  ^ 


The  series  in  the  first  term  of  (9)  is  majorized  by 


Z  ^Elxl'^Klxl  <  D  d,  ) 
k=l  c^       I  I  -  o  k 
k 


«>     k 

E  —   Z  E|x|^I(D^d^  .  <  Ixl  <  D  d  ) 

k  =  1  c,^  n=1        °  "-^    I  I  -  o  n 
k 


=  E  ElXj'^KD^d  .  <  Ixl  <  D  d  )  Z  — 
„  1  '  '  0  n-1  I  '  -  o  n  ,  q 
n=1  k=n  c, 

k 


<   Z  p{d  d   .  <  Ixl  <  D  d  }D^d^   Z  — 

n=l  k=n  c, 

k 


<  CD^   Z  nPlD^d^_^  <  |X|  <  D^d^}  (by  (8)) 


»   n 
:  z   z  p{d  d  ,  <  1x1  <  D  d  i 

n=l  k=1    °  ""^    I  I  -  o  n^ 


00       00 

C  Z   Z  p{d  d  ,  <  Ixl  <  D  d  } 
k=1  n=k   °  "-^    '  '  -  °  " 
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C  I   P{\X\    >    D  d    } 
k=1        "  '^  ' 


<  C[1+  E  P{|X|  >  D  d,  1] 
k=1         °  ^ 


<  C[1+  Z  P{|X|  >  DC,  }]  <  »  (by  (6)) 

k=1        ^ 


thereby  proving  the  lemma.  D 

As  previously  noted,  if  the  sequence  |x  ,  n  >^  1  }  is  identically 
distributed  then  (3)  is  automatic,  but  this  is  hardly  necessary.   It 
is  quite  easy  to  show  that  if  the  sequence  {x  ,  n  >  1 }  belongs  to  a 
scale  family  then  (3)  holds  (subject  to  an  additional  assumption)  as 
follows.   (The  symbol  =  denotes  that  the  two  random  variables  have 
the  same  distribution.) 

Remark.      Let  X^  =  qX,   n  >  1,  a  >  0,  and  sup  a  <  ==.   Then 
n    n    —     n         ^T  n 

n>1 

n^f,l  •  n  >  l}  is  stochastically  dominated  by  |x|. 

Proof.   Let  D  =  max {l, sup  a  }.  Then  for  all  n  >  1,  t  >  0 

n>1   " 


PlIX^I  >  t}  =  p{|o^X|  >  t} 

=  p1|x|  >  t/a  }  <  P{|X|  >  ^} 

'  '      n'  -  ' '  '   sup  0  ' 

n_>1 
<  DP{|X|  >  t/DJ.  D 


80 


A  well-known  example  of  a  scale  family  is  the  class  of  mean  zero 
normal  random  variables. 

Equation  (6)  compares  the  magnitude  of  the  tail  of  the 

distribution  of  the  random  variables  and  the  constants.   It  is  well 

known  (see,  e.g.,  Chow  and  Teicher,  1978,  pp.  89-90)  that  whenever 

0  <  d  +  <»  (strictly),  for  every  random  variables  X 
-  n 


I   P{|X|  >  d  }  <  Ed  \\X\)    <   Z  P{ix|  >  d  }  (10) 

n=1         "  n=0         " 


where  d(')  is  a  strictly  monotone  extension  of  {d  ,  n  _>  1  }  to 
[0,").  Hence,  in  some  situations  the  question  as  to  whether  or  not 
(6)  holds  is  immediate  since,  for  example,  from  (10)  we  obtain 


X  e  3(^    iff    I  P{|X|  >  n^^P}  <  ».  (11) 

^        n=1 


Finally,  we  need  to  comment  on  condition  (5).   It  is  clear  that 

if  |c  ,  n  >  1  }  is  of  the  form  c  =  n  ,  for  some  a  >  0,  then  (5) 
n    —                 n 

obtains  iff  q  >  — .  The  question  at  hand  is  when  does  (5)  hold  for  an 
a 

arbitrary  {c  ,   n  >_  ]}?     The  next  three  lemmas  address  this  question. 


Lemma  3-3>   If  0  <  c  '^  and  q  >  p  >  0,  then 


E  —  =  0(n/cP) 

P       "^ 
k=n  c, 
k 


implies 
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I  —  =  0(n/c^) 

l<=n  c, 
k 


Proof.   Note  that  c  +  and  q-p  >  0  ensure  that      < 


k   >  n  >   1 .     Therefore   if 


Q-p  -  ^q-p 
k  n 


then 


I     —  =  0(n/cP), 

k=n  0, 
k 


k=n  c2       k=n  cf.cJ-P  "c^'P   k=n  c^ 
k  k     k  n  k 


0(n/cP)    =  0(n/c^).    D 


q-p  n  n 

c 
n 


Lemma  3.^.     IfO<a+,   o<b     t,    and 
—  '    n'  n 


b'^  Z     —  =  0(n)    for  some  q  >  0, 
then  b  ■^  <»  and  (5)  holds  with  the  same  q. 

00 

Proof.  Since  b''  Z  —  =  0(n)  we  obtain  b  -»•  »,  whence  b^  +  <». 
n  .   ^q  n  n 

j=nb. 

Clearly  c     =  b  /la    I    +  and 
n         n    '    n' 


CO  ■"     ,              b              "       a . 

max  cj      Z     ^  =   0*5      Z     ^  =    (t-^)'^      Z    i^)"^ 

IX,  xk.          q  n.          q            a             .          b. 

Kk£n       j=n  c?  j=n  c.          '    n'        j=n       j 
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<  b*^  E  —  =  0(n) 
-  "j=nb] 

thereby  proving  the  lemma.  □ 

Lemma  3«5.   Suppose  0  <  c^/n  +  for  some  q  >  0.   Then  (5)  holds  iff 

c 

lim  inf  >  r  for  some  integer  r   >  2.  (12) 

c  — 

n->'<»         n 


a  1/q   1/q 
Proof.      Let  d     =  c   /n,   n   >   1.      Then  d      t  and  c     =  n       d        , 
n         n             -                        n                  n  n 

n  >    1.      So   (12)    is  equivalent   to 


,      v1/q,,      v1/q 
(rn)        (d      ) 

-,  .      .    ^  rn  V      1/Q 

lim  inf  —. — —. >  r        , 

1/q.1/q 
n-*-"  n       d 

n 


for  some  integer  r  >   2.     This,    in  turn,    is  equivalent  to 


d 
lim  inf  - —  >   1  , 
n->«>         n 


for  some  integer  r  >  2.   On  the  other  hand,  (5)  is  equivalent  to 


k=n   k      n 


Hence  we  need  only  show  that,  whenever  0  <  d  +, 


k=n   k      n 
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is  equivalent  to 


d 

rn 
lim  inf  - —  >  1    for  some  integer  r  >  2. 
a  — 

n^«>    n 


This  equivalence  was  proved  by  Martikainen  (1985).  D 

The  following  lemma  is  quite  useful  in  our  work.  From  (5)  it  is 

clear  that  0  <  c  ^  <»,  but  if  c  /n  t  for  some  a  >  0,  then  (6)  can  be 
n  n 

weakened. 


Lemma  3.6.   Let  X  be  any  random  variable  and  let  {c  ,  n  ^  1 }  be 

constants  such  that  0  <  c  /n  +  for  some  a  >  0.  Then  either 

n 


Z  P  X  >  Ac   <  "     for  all  X  >  0 
,   '  '     n 
n=1 


or  else 


Z  P{|X|  >  Xc  }  =  <»     for  all  \  >  0. 
n=1 


Proof.  See  Stout  (197^,  p.  131-132)  or,  for  a  new  simple  proof,  see 

Rosalsky  (1985).  D 

Thus,  if  0  <  c  /n  '^  for  some  a  >  0,  then  in  order  to  verify  (6) 
n 

we  need  only  check  that 


I  P{  X  >  Ac  }  <  "     for  some  A  >  0. 
' '  '     n 
n=1 
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3.3  Generalized  Strong  Laws  of  Large  Numbers  for  Weighted  Sums 
of  Stochastically  Dominated  Random  Variables 

With  these  preliminaries  accounted  for,  the  first  major  result 

of  this  chapter  may  now  be  established.   It  is  unfortunate  that 

indicators  are  present  in  u  of  the  conclusion  (15)  of  Theorem  3.I. 

n 

However,  under  additional  conditions,  it  is  shown  that  (18)  holds 
wherein  the  v„  do  not  involve  indicator  functions. 

Theorem  3.1.   Let  Ix  ,  n  >  1 }  and  X  be  random  variables  such  that 

'  n    -      ' 

(|X  |,  n  >^  1  }  is  stochastically  dominated  by  |x|  in  the  sense  that 
there  exists  constants  D.  <  «>,  1  =  1,2  such  that 


P{|X  I  >  t}  <  D  P{|X|  >  t/D  }    t  >  0,  n  >  1.         (13) 

Let  |a  ,  n  >  1 }  and  lb  ,  n  >  1  I  be  constants  satisfying  0  <  b  +  " 
'  n    —        ^  n    —  J   °      ^ 

and  (5)  with  q  =  2,  where  c^^  is  defined  by  (2).   If 


I  P{|X|  >  D^c  }  <  »  (14) 

n=1         3  n' 


for  some  constant  D.  <  ",  then  for  every  M  >_  DpD^  the  GSLLN 


^^ r ^  0   a.s.  (15) 

b 
n 


obtains  where  y  =  EX  I  ( |  X  |  <_  Mc  )  and 

u  =  e{x  K Ix  I  <  Mc  ) Ix  ,  .  .  .  ,X   I,  n  >  2.   Furthermore,  if 
n    ^  n   I  n'  -   n  '  1         n-1     - 
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and 


then 


G  =  0  inf  c,  )  (16) 

n     ,  V   k 
k>n 


"   1 
c   I     —  =   0(n)  (17) 

k=1   k 


n 

Z  a,  (X,  -V,  ) 
,  ,  k  k  k 

ii^l— ^  0   a. 3.  (18) 

D 
n 


where  v  =  EX  and  v  =  e(x  |X  ,  .  .  .  .X^_-|}.  n  >  2. 

Proof.   Let  M  >  D  D  .  The  hypotheses  ensure  that  (3)  and  (6)  hold 

with  D  =  maxfo  ,D  ,D  },  whence  by  Lemma  3-2,  (7)  obtains  with 

q  =  2.   Let  Z  =  X  I( Ix  I  <  Mc  ) ,  n  >  1 .  Define  X„  =  0  and 
^  nn'n'-n'-  0 

't  =  a(X„ X  ),  n  >  0.   Observe  that  for  k  >  1,  u,  is 

(rn  0  n     -  —     k 

^   -measurable  and  hence 


k  k 

a 

Thus,  |r^(Z  -u  ) ,%    ,  n  >  1 1  is  a  martingale  difference  sequence, 
'b   n  n  "  n    -  '        „     ^ 
n  k 

This  is  equivalent  to  saying  that  {  Z  T^^'^u'^u^  '^ n'   "  >.  ^  J  ^^  ^ 

k  =  1   k 
martingale. 

It  will  now  be  shown  that  for  i  <  j 


E(Z.-u.)(Z.-p.)  =  0.  (19) 

11   J   J 
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Observe  that 


e(z.-m.)(Zj-mJ  =  e{e{(z.-u.)(Zj-mJ|Jv._^}} 


E{(Z.-,.)Elz.-p.|^._^}}  ^_ 


(since  Z.-y.  is 
1   1 


-measurable) 


Next,  it  will  be  shown  that 


n  a 

I     — (Z  -p  )     converges  a.s.  (20) 

k  =  1   k 


In  view  of  the  martingale  convergence  theorem  (see,  e.g.,  Breiman, 
1968,  p.  89)  it  suffices  to  show  that 


n  a 

lira  sup  El  Z  — (Z,  -u,  )|  <  ".  (21) 

',  ,  b,   k  K  ' 


Note  that 


^l<V\>'l?k-,l 


(since  p  is 
^^^kl^k-l^  -  ^\'^K\^^-^^    '   \  ^,_  -measurable) 


k-1 


'k'^k-r    ^k 


<E(z^|?, 


k'«k-l^ 
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Thus 


n  a         2 
lim  sup(E|  I  —{7.^-u^)\) 


"  ^k        2 
<  sup  E(  Z  — (Z,  -y,  )) 

"  n>1    k  =  1^1<   "   " 


=  suplE  Z  (^)2(Z^-M^)2  -  2EZ  '^00(Z.-y.)(Z  -y  )} 
n>l   k  =  1   k  Kj   i   J 


sup{  I     ^E(Z^-p^)2  .  2Z j(^)E(Z.-p.)(Z  -p  )} 
n>1  k=1  c  i<j   1  J 


Z    l^ECZ^^-Uj^)^  (by  (19)) 

k  =  1  c, 
k 


Z_i^E|E|(Z^-„^)^|J^_,|) 


k  =  1  c, 
k 


k  =  1  c, 
k 


k  =  1  c, 
k 


k  =  1  G, 
k 


as  already  noted,  whence  (21)  obtains  thereby  establishing  (20) 

UsinK  b  •^  °°  and  the  Kronecker  lemma,  we  conclude 
n 


However , 


!^ — ^0        a. 3, 

b 
n 


jy\-\^  J^y^^''^^  i^'k^v^k^ 


and  the  second  term  is  o(1)   a.s.    via  b     ^  »  and  the  Borel-Cantelli 

n 

lemma  since 


E  P  X     *  Z       =      E  P     X       >  Mc 
'   n         n'  ,      '    n'  n' 

n=1  n=1 


<     E  PJIX    I    >  D„D_c    }  (since  M  >   D  D    ) 

n=1 


<   D      E   pIIxI    >   D,c    }   <   "  (by    (13)    and    (14)) 

n=1 


Hence   (15)   obtains, 
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Now  under  (17),  c  <  Cn  for  all  n  >_  1  whence  for  all  k  >_  1 


E  PljX  I  >  CD  D  n}  <  D   E  P{|x|  >  CD  n}      (by  (13)) 
n=l  ^      n=l         ^ 


<  D,  E  pIIxI  >  D^c   <  «>  (by  (14)) 

-  ^n=1        3n' 


Therefore,   via   (11),   we  obtain  e|x|    <   «>  and  E|x    |    <  «>,    k  _>   1  .      This 

in  turn  guarantees  that  the  conditional  expectations  all  exist. 

Let  e  =  inf  c,  ,  n  >  1 .  Note  that,  via  (5),  e  +  "  and 
n   ,  >    k    —  n 

k^n 

e  <  G  ,  n  >  1.  Under  (16),  e  <  c  <  Ae  for  some  1  <  A  <  ». 
n  -     n'       -  n-n-n  — 

Let  N  >  MA.  Utilizing  Lemma  2.4  we  obtain 


eIx  IkIx  I  >  No  ) 
'  n'   '  n'     n 


=  No  pIIx  I  >  Nc  }  +  [   P{ IX  I  >  t}dt 

Nc 

n 


<  D,Nc   p(1x|    >   Nc  /dJ    +   dJ        p{|x|    >   t/D-}dt  (by    (13)) 

-In''  n     2 '  1  •'  »T^  2 ' 

Nc 
n 


D^CNc^PJlD^Xl  >  Nc^}  +  /   pIId^xI  >  t}dt] 

Nc 
n 


D,E|D-X|I(|D  X|  >  Nc  ). 
I  '  2  '  '    2    '  n 


Therefore 


Z  —EX   I(  X    >  Nc  ) 
,  c   '  n '   '  n'     n 
n=1   n 
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<  D,   I  — E|D  yil(iD-X|  >  Nc  ) 


1    -  c   '2 
n=1   n 


<  D.   E  — E|D„X|I(|D_X|  >  Ne  ) 


n=l   n 


n=1   n  k=n 


(since  e  t  co) 


=  D   E  E|D  X|l(Nej^  <  |D  x|  <  Ne^^^  )  E  ^ 
k  =  l  n=l  n 


<  D^   ENe^^^PlNe^  <  \D^X\    <  Ne,^^  }  E  '- 
k=1  n=1   n 


k  +  1 


<  D^N  EPlNe^  <  iD^Xl  <  Ne^^^  }c^^^   E  - 
k=1  n=1  n 


(since  e.  <_  c.  ) 


<  D,N  E  P  Ne,  <   D^X   <  Ne,  ,  C(k  +  1) 
—  1  ,  ^-    k    '  2  '  —   k  +  1 


(by  (17)) 


D  NC  E  (k+l)p{Ne  <  |D  X|  <  Ne    } 
k=1 
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<   2D ,NC   I   kPJNe,     <    Id^xI    <   Ne,  ^. 
-       1      L;=i  ^        '    2    '    -       k  +  1 


00       k 
C   I        £  P|Ne|^   <    iD^Xi    <   ne^^^} 
k=1    n=1 


00  00 


C   Z        Z  P{lie^   <    [D^XI    <   ne^^^ 
n=1    k=n 


C   Z  pIId^xI    >   Ne^} 
n=1 


<  C  Z  p{|D  X|  >  Mc  }  (since  Ne  ^  ^®  2  ^'^   ^ 

~     n=1  " 


<  C  Z  Pllxi  >  D^c  }  <  "  (by  M  >  D„D_  and  i^'4)). 

-  n=1   '  '    3  n'  -  2  3 


Hence,  we  obtain 


Z  — eIx  IKIX  I  >  Nc  )  <  ".  (22) 

,  c   '  n '   '  n '     n 
n=1   n 


Next,  it  will  be  shown  that 


Z  — EX   I(Mc   <   X   <  No  )  <  ".  ^23) 

,  c   '  n'    n   '  n'  -   n 
n=1   n 
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Using  (13)  and  the  fact  that  M  >_  D  D  we  obtain 


1 


E    — eIx    IKMc     <    Ix   i   <  Nc„) 
,    c      '    n'  n        I    n'   -       n 

n=l      n 


<  N   Z   P  Mc     <     X        <   Nc    } 
-  '      n        '    n'   -       n' 

n=l 


<   N    Z   P      X        >   Mc 
-  ,       '    n'  n' 

n=1 


<  ND        Z   P{|X|    >   Mc   /D    } 
n=1  " 


<  ND,       Z   PJIx!    >    D^c    }    <    "  (by    (1^1)) 

-       ^    n=l  3  n 


establishing   (23).     Combining    (22)   and   (23)   yields 


Z     — eIx    iKlx    I    >  Mc   ) 
,    c     '    n'      '    n'  n 

n=1      n 


Z     — Elx    iKMc      <    Ix    I    <   Nc    )    +      Z     ^E|X JKJX    I    >   Nc    )    < 
'-c'n'  n        'n'-       n  ,c'n''n'  n 

n=1      n  n=1      n 


Hence  by  the  Beppo-Levi   theorem, 


93 


E   Z     — e{|X    iKlX    I    >   Mc    )|^    ,  } 
c      ^ '    n'      '    n'  n   '^  n-1  ' 


n=1      n 


I     ^E{E{|XJI(1XJ    >Mcj!^^_,}| 


n=1      n 


Z     —EX     I      X        >   Mc    )   < 
,    c      '    n'      '    n '  n 

n  =  1      n 


This  implies  that 


"     |a    I 

Z     — ^e{|x    IKIX    I    >   Mc    )\Ji    J   <    "       a. 3, 
n=1        n 


Then  by  Jensen's  inequality  for  conditional  expectations  and  the 
Kronecker  lemma  we  conclude  that 


n 

k  =  1    "     ^     ^ 

b 
n 


I    Z   a|^(E{x^^I(|xJ    <   MCj^)|^^_^}   -   e{xJ^_^}) 

_ 
n 


I    ^   \E{X^I(|XJ    >   Mc^)\Z^_^]\ 


b 
n 


n 
Z 

k  =  l 


I    iajE{|xJl(|xJ    >  Mc^)|^_^} 


— ->■  0       a.s, 

b 
n 


9^ 


Therefore,  recalling  (15), 


j/k^V\^    },\^h-\^    .V^^'^"^^ 

b  b  b„ 

n  n  n 


thereby  proving  (18).  D 


Remark.  Note  that  condition  (16)  is  automatic  if  c  +. 

Furthermore,  if  c  /n  +  for  some  a  >  0  then,  via  Lemma  3.6, 
n 


E  P  X  >  Ac   <  "    for  all  A  >  0. 
,      '    '  n 

n=1 


Consequently,  D„A  and  hence  M  can  be  chosen  arbitrarily  small  and  so 
(15)  holds  for  all  M  >  0. 

This  first  corollary  is  a  well  known  SLLN  for  sums  of  i.i.d. 
random  variables  and  is  essentially  due  to  Feller  (1946).   It  is  an 
extension  of  the  Marcinkiewicz-Zygmund  SLLN  to  more  general  norming 
constants. 


Corollary  3.1  (Feller,  19^6).   Let  {x,  X  ,  n  >  1 }  be  i.i.d.  rand 


om 


variables  and  let  lb  ,  n  >  1  1  be  positive  constants.   Suppose  that 

n    - 


either 


or 


or 


(i)EX=0,  n=0(b) 

n 


a  1 

( ii)  EX  =  0,  b  /n  +,  b  /n  t  for  some  a  >  ^ 

n      n  2 


(iii)  eIxI  =  ",  b  /n  +. 
'  '       n 
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If 


then 


Z  P{|X|  >  b  }  <  ",  (24) 

n=l         " 


n 

^^^^i—   ■>  0   a.s.  (25) 

D 
n 


Proof.   Clearly  (13)  holds  with  D  =  D  =  1  and  X  =  X^ . 

Defining  a  =  1 ,  n  >  1  ,  we  obtain,  via  (2),  that  c  =  b  ,  n  >  1. 
n  -  n    n    — 

Thus  (24)  is  equivalent  to  (14)  where  D^  =  T  . 

g 

Suppose  (il)  or  (iii)  hold.   Then  b  t  »  and  b  /n  t  for  some 

n         n 

6  >  1/2.  Therefore 


b  /(rn)"^ 

b  /n^   ~ 
n 

for  all  integers  r  >_  2.   Hence,  in  particular,  r —  >_  2  >  2    and  so 

n 

T   .  „  '^2n  .  „1/2 
lim  mf  z —  >  2 
b 
n-**    n 

2 

This  together  with  b  /n  +  shows  that,  via  Lemma  3-5, 

n 


b^   E  ^  =  0(n) 

k=n  b, 
k 


Utilizing  Theorem  3.1  we  conclude  that 
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ii^l- ^  0       a.s.  (26) 

D 

n 


where  u     =  EXKlxl    <  b   ),    n  >    1.      It  remains   to  show  that 


n 

I  u,    =  o(b   )  (27) 

k  =  l    '^ 


in  each  of  the  cases  (ii)  and  (iii). 

2  .  1 


In  case  (ii),  we  have  EX  =  0,  b  /n  +,  b"  Z  ^  =  0(n), 

"        k=n  b, 
k 

CO 

and  E  P| Ixl  >  b  I  <  "  which  are  sufficient  for  (2?)  (see  Chow  and 
,   '  '    n 
n=l 

Teicher,  1978,  p.  124), 


2     1 
In  case  (iii),  note  that  b  /n  t  «>,  b   Z  -r  =  0(n),  and 

"        "  k=n  b, 
k 

00 

Z  P{|x|  >  b  }  <  "  all  hold.   As  in  the  previous  case  these 
n=1 

assumptions  imply  (27)  (again  see  Chow  and  Teicher,  1978,  p.  124). 

Therefore  in  either  case  (ii)  or  (iii),  both  (26)  and  (27) 
obtain  and  then  (25)  follows. 

Next,  suppose  (i)  holds.   Then  by  applying  case  (ii)  with  the 
norming  constants  b'  =  n,  n  >_  1  ,  it  follows  that 


n 

k  =  1  ^   ^ 

^0   a.s. 

n 


Since  n  =  0(b  ) 
n 
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n 

n 

k=l    ^ 

n 

k=l    ^ 

b      b      n 
n     n 


thereby  proving  case  (i)  and  the  corollary.  Q 

Remark.   It  will  now  be  shown  that  under  case  (ii)  the  condition  (2^4) 
need  not  be  assumed,  but  rather  is  automatic. 

Fact.   If  (x,  X  ,  n  >  1 }  are  i.i.d.  random  variables  and 

lb  ,  n  >  1  1  are  positive  constants  with  EX  =  0  and  n  =  0(b),  then 
'  n    -  n 

(24)  holds. 


Proof.   Since  n  =  0(b  ),  there  is  some  finite  constant  C  such  that 

n  <  Cb  .   Utilizing  (11),  with  p  =  1,  we  obtain 
-   n 


Z  P{|CX|  >  n}  < 
n=l 


Therefore 


I  P{ |x|  >  b  }  <  Z  Pj |CX|  >  n}  <  ".  n 
n=l        "    n=l 


As  pointed  out  previously,  Corollary  3-1  is  a  generalization  of 
the  Marcinkiewicz-Zygmund  SLLN.   The  Marcinkiewicz-Zygmund  SLLN  is, 
in  turn,  a  generalization  of  the  famous  Kolmogorov  SLLN  (see,  e.g.. 
Chow  and  Teicher,  1978,  p.  122).   The  next  corollary  extends  Theorem 
5.2.3(ii)  of  Chow  and  Teicher  (1978,  p.  123). 
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Corollary  3-2.   Let  {x,  X  ,  n  >_  1  }  be  i.i.d.  random  variables  with 

EX  =  0.   Let  {a  ,  n  >_  1  }  and  {b  ,  n  >_  1  }  be  constants  satisfying 

0  <  b  +  ", 
n 


n 

Z 

1<  =  1 


Z  |a,  I  =  0(b  ),  (28) 

'  k '      n 


and  (5)  with  q  =  2.   Then 


n 

I  a,  X, 

k  =  1  '  ' 

b 
n 


^  0   a.s.  (29) 


iff 


Z  P{|X|  >  c  }  <  "  (30) 


n=1 


where  c  is  as  in  (2) . 
n 

Proof.   Again,  let  D  =  D  =  D  =  1  and  hence  (13)  and  (14)  hold. 

Thus,  via  Theorem  3.1,  (15)  obtains  with  p  =  EXKlxl  <  c  ),  n  >  1, 

n       '  '  —  n     — 

and  so  if 


n 

^  Vk  =  °^^n^  ^31) 


then  (29)  follows.   To  prove  (31),  note  that  (5)  ensures  that 

c  +  »,  implying  by  the  Lebesgue  dominated  convergence  theorem  that 

y  ->  EX  =  0.   Then  (31)  follows  immediately  from  (28)  and  the 


Toeplitz  lemma. 
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Conversely,  if  (29)  holds,  then  for  all  n  >  2 


X     la  X  I    I  ^,W   ~   ,  ^Vk 
rii    '  n  n'    k  =  l       k  =  1 


c  I     b  b 

n  x\  n 


n         n-1 

k=1  *"  ''  ^   k=1  ^  ^      ^ 

<  r +  — r ->  0   a. 3. 

-     b        b  , 
n        n-1 


Therefore 


PJIx  /c  I  >  1  i.o.  (n)}  =  0 
'  n  n' 


and  (30)  follows  by  the  Borel-Cantelli  lemma.  D 

The  similarities  and  differences  between  Theorem  3.1  and  the 
next  result  are  quite  evident.   It  should  be  noted  that,  via  Lemma 
3.3,  if  c  t  and  (5)  holds  with  q  =  1  then  (5)  obtains  with  q  =  2. 
In  the  special  case  where  {x  ,  n  >_  1 |  are  identically  distributed  and 
a  =1,  Theorem  3.2  reduces  to  Theorem  2  of  Martikainen  and  Petrov 
(1980). 


Theorem  3.2.   (i)   Let  (x  ,  n  >  1  }  and  X  be  random  variables  such 
n    - 

that  {|X  |,  n  >  l}  is  stochastically  dominated  by  |x|  in  the  sense 


n 
that  there  exists  a  constant  D  <  «>  such  that 


P(|X  I  >  t}  <  DP{|X|  >  t/D},  t  >  0,  n  >  1.  (32) 
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Let  (a  ,  n  >  1 1  and  lb  ,  n  >  1  }  be  constants  satisfying  0  <  b  + 
^  n    -         n    -  ^   °      P 

and  (5)  with  c  as  in  (2)  and  q  =  1.   If 
n 


I  P{|X|  >  Dc  }  <  -,  (33) 

n=1 


n 

then  I  a,  X  /b  -»  0  a.s. 
,  ,  k  k  n 
k  =  1 

(ii)   Conversely,  let  (x  ,  n  >_  1 }  be  pairwise  independent  random 

variables  and  let  la  ,  n  >  1  1  and  |b  ,  n  >  1  I  be  constants  with 

'  n    -         n    - 

00 

b  >  0  and  b  ,  =  0(b  ).   If  E  a,  X, /b  ->  0  a.s.,  then 
n         n-1      n      ,  ,  k  k  n 

k  =  1 


E  P  X   >  ec   <  "    for  all  G  >  0.  (34) 

,   '  n'     n 
n=l 


Proof,   (i)  By  the  Beppo-Levi  theorem  and  Lemma  3-2, 


k  =  l   k 


k  =  l   k 


whence 


k=l   k 


101 


Then,    by  the  Kronecker  lemma,    It  follows   that 


"  2 

^    |a^xjl(|xj    <   D   c^) 

— ^  0       a.s.  (35) 

n 


However,  by  (32)  and  (33) 


IPX  *  X  I(  X   <  Do 
,  '  n    n   '  n'  -    n  ' 
n=1 


Z  P{|X  I  >  D^c  }  <  D  Z  PJIx!  >  Do  }  <  ". 
'  '  n'      n'  -    1   '  '     n 
n=1  n=1 


The  Borel-Cantelli  lemma  then  ensures  that 


Pflim  inf[X  =  X  I(|x  I  <  Do  )]}  =  1 
'        n    n  '  n'  -    n  ' 


implying,  via  b  ^  «>,  that 
n 


.2 


•^"^  ^  0   a.s.  (36) 


b 
n 


Combining  (35)  and  (36)  yields 


k=l  ^  ^  ^  k=l  ^  " 


b     -    b 
n         n 
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n  n 

^    \\\\^^\\\    <  D  \)  ^    |a^Xjl(|xJ    >   D  c^ 

k  =  1  .    k  =  l 


+ 


b  b 

n  n 


^0        a.s. 


proving  part   (i). 

(ii)      If   (29)    and  b   _     =  0(b   )    hold  we  obtain,    for   all  n  >_  2, 


n  n-1 

Z  a  X     -     I 
V'ni  k  =  1        ^       k  =  1 


|a  X    I         I    Vk^k   ~  ,  ^^k^l 


b  b 

n  n 


\}yj    b  ,    i//k\i 

,     k=1  n-1  k=1                   - 

<   r +  —r •    r ^    0         a.s, 

-            b  b  b      , 

n                  n  n-1 


Therefore  P{|X  I  >  ec  i.o.  (n)}  =0  for  all  e  >  0,  and  so  (3^) 
'  n'     n 

obtains  by  the  Borel-Cantelli  lemma  for  pairwise  independent  events 
(see,  e.g.,  Chung,  197^,  p.  76,  or,  for  a  new  simple  proof,  Etemadi , 
1984).  D 

Remark.   If  we  replace  conditions  (32)  and  (33)  of  Theorem  3.2  with 
(13)  and  (14)  then  the  conclusion  of  Theorem  3-2(1)  still  obtains. 


Proof.   Suppose  that  (13)  and  (14)  hold.   Let  D  =  maxJD  ,D  ,D  }, 
Then  if  (13)  holds  we  obtain,  for  all  t  >  0  and  n  >  1, 


p1|X  I  >  t}  <  D  p(|x|  >  t/D  }  <  DP{|X|  >  t/DJ, 
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which  is  (13).   Next,  if  (14)  is  satisfied,  then 


Z  P{|X|  >  Dc  }  <   Z  P{|X|  >  D^c  }  <  ", 
n=1  n=l 


whence  (33)  obtains.   The  remark  then  follows  from  Theorem  3-2.  D 

Theorem  3.2  produces  a  few  immediate  corollaries,  the  third  of 
which  is  a  result  of  Martikainen  and  Petrov  (1980). 

Corollary  3-3.   Let  {x,  X  ,  n  >_  1  }  be  pairwise  i.i.d.  (p.i.i.d.) 

random  variables.   Let  la  ,  n  >  1  I  and  lb  ,  n  >  1  }  be  constants  with 

'  n    -  '     ^  n    - 

0  <  b  +  ",  c  +  and 
n      n 


c^  Z  ^  =  0(n).  (37) 

n  ,    c, 
k=n  k 


n 


Then  Z  a,  X, /b  ->  0  a.s.  iff  (30)  holds. 
,  ,  k  k  n 
k  =  l 


Proof.   Suppose  (30)  holds.   Then,  by  letting  D  =  1  and  X  =  X  we  see 

that  (32)  holds  and  (30)  is  tantamount  to  (33).   Noting  that  c  +,  it 

n 

is  evident  that  (37)  is  commensurable  to  (5)  when  q  =  1.   Thus,  all 
the  hypotheses  of  Theorem  3.2(i)  are  satisfied,  whence 

n 

Z  a,  X,  /b  -►  0  a.s. 
,  ,  k  k  n 
k  =  1 

For  the  converse,  note  that  if  0  <  b  +  <»  then  b  ,  =  0(b  ). 

n  n-1      n 

n 

Then  if  Z  a  X  /b  -*   0  a.s.,  we  can  conclude  (3^)  with  e  =  1  which  is 
,  .  K  K   n 
k=l 


tantamount  to  (30).  D 
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Corollary  3.4.   Let  (x,  X  ,  n  >_^}   are  p.l.i.d.  random  variables. 

Let  la  ,  n  >  1  I  and  jb  ,  n  >  1  }  be  constants  where  0   <    \a    \    ■*■ , 
'  n    -       '  n    -  '  '  n' 

0  <  b  +,  and 

n 


b   I     r-  =   0(").  (38) 

n  ,    b, 
k=n  k 


n 

then  Z  a,  X  /b  ■*  0   a.s.  iff  (30)  holds. 
,  ,  k  k  n 
k  =  l 

Proof.   Since  b  +  and  la  |  +,  we  obtain  c  t.   Since  b  +  ^ 
n       '  n'  n  n 

(by  (38)),  in  view  of  Corollary  3.3,  it  remains  to  show  that  (37) 

holds.   However,  this  is  immediate  since,  via  Lemma  3-4,  0  <  b  +  *, 

n 

0  <  |a  I  +,  and  (38)  ensure  (37).  D 

Corollary  3.5  (Martikainen  and  Petrov,  1980,  Theorem  2).   (i)   Let 

{x,  X  ,  n  >_  1 }  be  identically  distributed  random  variables.   Let 

|b  ,  n  >  1  I  be  a  sequence  of  constants  satisfying  0  <  b  +  °°  and 
^  n    -  '        ^  -^   °      n 

(38).   If 


Z  P{\X\    >  b^}  <  "  (39; 

n=l 


then 


n 

^  \ 

i^^^  ->  0   a.s.  (40) 

b 
n 


(ii)   Conversely,  if  the  random  variables  |x,  X  ,  n  >  ll  are 

n    - 

p.i.i.d.  and  (b  ,  n  >^  1  }  is  a  sequence  of  positive  constants  with 

b  t  o",  then  (40)  implies  (39). 
n 
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Proof,   (i)  Utilize  Theorem  3.2(i)  with  D  =  1,  X  =  X  ,  and 

a  =1.  Hence  (32)  and  (33)  are  satisfied  since  c  =  b  ,  n  >  1 
n  n    n    — 

Then  (38)  is  tantamount  to  (5)  with  q  =  1,  whence  (40)  follows, 
(ii)  This  follows  immediately  from  Theorem  3.2(ii).  □ 


3.4  Generalized  Strong  Laws  for  Large  Numbers  for 
Weighted  Sums  of  Mean  Zero  Random  Variables 

The  previous  section  was  devoted  to  GSLLNs  for  stochastically- 
dominated  random  variables.   This  section  will  focus  on  the  GSLLN 
problem  when  the  random  variables  are  i.i.d.  with  m.ean  zero.   Since 
the  hypotheses  imposed  on  the  distributions  of  the  random  variables 
{x  ,  n  >_  1  }  are  being  strengthened,  our  goal  will  be  to  weaken  the 
assumptions  placed  on  the  sequences  {a  ,  n  >_  1  I  and  {b  ,  n  >_  1  } . 

The  first  theorem  of  this  section  was  motivated  by  Fernholz  and 
Teicher  (1980)  and  produces  some  of  their  results  as  corollaries. 


Theorem  3.3.   Let  JX,  X  ,  n  >_  1 }  be  i.i.d.  ^  random  variables  for 

some  1  <  p  <  2  where  EX  =  0.   If  (a  ,  n  >  1  I  and  lb  ,  n  >  1  I  are 
-  n    -  '     ^  n    - 

sequences  of  constants  with  0  <  b  +  °°, 

n 

p-3 

a  /b  =  0(n  ^  ),  (41 ) 

n  n 


and 


1    |a  I  =  0(b)  (42) 

k=1   "       "^ 


then 
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n 

Z  a ,X, 

k=1  "  " 

^ >  0   a. 3.  {^3) 

n 


a 

Proof.   Let  Z   =  X  I( Ix  I  <  n) ,  n  >  1  ,  and  W  =  -^(Z  -EZ  ), 

n    n'n'--        nbnn 

n 

n  >  1 .   It  will  be  shown  that  the  series 


I  W    converges  a.s.  (44) 

n=1 


By  the  Khintchine-Kolmogorov  convergence  theorem  (see,  e.g., 
Chow  and  Teicher,  1978,  p.  110)  we  only  need  to  show  that 


Z  EVr  <  ".  Now 
n=1 


00  a 


Z  EV^  =   Z  (t:^)^E(Z  -EZ  )^ 
n     ,  b      n   n 
n=l      n=1   n 


"a  "'^00 

<   Z  (-^)^E(Z^)  =   Z  (-^)^EX^I(|X|  <  n) 
"  n=l  ^n     "    n=1  ^ 


"an 

I   (r^)   Z  EX  I(k-1  <  |x|  <  k) 
n=l   n   k=1 


CD  °o    3 

Z  EX^I(k-l  <  |xi  <  k)  Z  (r^)^ 
k=l  n=k  n 
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<  Z   EX^I(k-1  <  |X|  <  k)C  I  n^  ^        (by  (i<l)) 
k=l  n=k 


<  C  Z  k'^  ^EX^I(k-1  <  |X|  <  k) 
k=1 


<  C  Z   E|X|P|J|^"PI(K-1  <  |xi  <  k) 
k=1     ^ 


<  C  Z  E|x|Pl(k-1  <  |X|  <  k) 
k=l 


ce|x|^  <  ", 


whence  (44)  obtains  which  is  tantamount  to 


00  a 

Z  r— (Z  -EZ  )   converges  a.s. 

,  b   n   n 
n=l   n 


Next,  via  the  Kronecker  lemma  we  obtain 


n 

Z  a,  (Z,  -EZ,  ) 

k=1  ^   ^    ^    , 
r ->■  0   a.s. 

D 

n 


However, 
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ZPJZ      *X}=      ZP{|xj>n}<"  (by   (ID) 

n=1  n=1 


and  so  by  the  Borel-Cantelli  lemma 


P  lim  lnf[Z  =  X  ]}  =  1 
n    n 


Hence 


n  n  n 

Z  a  (X  -EZ  )  Z  a  (X  -Z  )  Z  a  (Z  -EZ  ) 

k=1  '^  '^   ^  k^l  ^  '^  '^  k  =  1  ^  '^   "^    „            ,„,, 

5 =  5 "  b "°   ^•^-      ^'*5) 

n  n  n 


Next,  we  show  that  the  sequence 


n 

^  \^\ 
k  =  1 
^^-^-^ =  0(1).  (l|6) 

n 


Let  e  >  0.   In  view  of  (42)  there  exists  a  constant  C  <  «>  such  that 


n 

^^^ <  C,     n  >  1.  (47) 

n 


Noting  that  e|x|  <  "  we  realize  that  there  exists  an  integer  n  such 

that  whenever  k  >  n 
—  o 


E|X|I(|X|  >  k)  <  |.  (48) 
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Thus,  for  large  n 


n 
^=^       <l-     I    |a  l|EXI(ix|  <  k) 


n       n  k  =  1 


1   " 

^  Z  |a  ||EXI(|x|  >  k)|  (since  EX  =  0) 

n  k  =  1      ^ 


n 

<^     Z°|a    |E|X|I(|X|    >   k)    ^  ^        I        |ajE|xil(|x|    >   k) 

n  k=l  n  k=n  +1 

o 


n 

<^/|ajE|x|    .1-       ?        |aj(§)  (by   (.8)) 

n  k=l  n  k=n  +1 

o 


<   o(l )    +  e  (by  b     -►  "  and   {^7)) 

—  n 


->■  e  as   n  >  <». 


Since  e  >  0  is  arbitrary  (46)  follows.   This  together  with  (45) 
yields 


X'V    =  "^ .  ^ .  0   a.s. 

b  b  b 

n  n  n 


thereby  proving  the  theorem.  D 
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Remark.   It  is  quite  evident  that  Theorem  3-3  resembles  Corollary 

3.2.   The  question  that  arises  is  whether  or  not  one  of  these  results 

implies  the  other.   It  will  be  shown  that  these  results  indeed  stand 

on  their  own  although  some  of  their  hypotheses  do  imply  those  of  the 
other. 

Fact.  If  X  e  ;;^   and  a  /b  =  0(n   )  for  some  1  <  p  <  2,  then 
u^v             n  n                   - 


I  Pi  X  >  c   <  «>. 
,"  '    n' 

n=1 

p-3 
1       2 
Proof.   Recall  that  c  =  b  /la  I  whence  —  <  Cn   ,  n  >  1, 
n    n  '  n'        c  -         - 

2 

or  c  >  en    for  some  e  >  0  and  all  n  >  1 .   Note  that  since 
n  -  — 


1  <  p  <  2,  iil|2£  >  1  .  Hence 


2 


I  P||X|    >   c    I    <      Z   P{|X|    >   en  "^    } 


n=1  n=l 


(3-p)p 

=      EPl|f|P>  n     2        } 
n-1       ^ 


<     Z  P{|-|^>  n}    <  »  (by   (ID).    D 


n=1        ^ 


Next,  it  will  be  shown  that  neither  result  implies  the  other. 


Example  3.1.   Let  {x,  X  ,  n  >_  1  }  be  i.i.d.  mean  zero  random 
variables.   Suppose  that  E|x|    <  ",  but  E|x|^  =  »  for  all 


Ill 


p  >  3/2.   If  a^  =  n   ^e",  n  >  1 ,  and  b  =  e",  n  >  1 ,  then  the 
hypotheses  (28),  (5)  (with  q  =  2),  and  (30)  of  Corollary  3-2  hold, 
but  the  hypotheses  of  Theorem  3-3  fail. 

Proof.   Firstly,  we  verify  (28)  (which  is  the  same  as  {^2)).      Observe 
that 


E  |a  I  =   Z  k  ^^^e*^  <   E  e*^  <  J    e^dx 
k=1       k=1         k  =  l      1 


n+1 
<  e    =  0(b  ) 
~  n 


Next,  we  establish  (5)  (with  q  =  2)  and  (30).   Note  that  c  =  n^^^ 

n 

and  hence 


max  c^  I     ^  =  n^^^     I     ^^  =  n^''2o(n"^  ^3)  =  0(n) 
1<k<n   j=n  c        j=n  j 


which  establishes  (5)  with  q  =  2.   To  show  that  (30)  holds,  note  via 
(11)  that 


I   P{|X|  >  cj  =   Z  P{|X|  >  n^^^}    <   » 
n=1        "    n=1 

3/2 
since  E|x|    <  ». 

Next,  we  show  that  the  hypotheses  of  Theorem  3.3  fail.   In 

this  example,  X  e  5^  iff  p  <_  3/2  which  is  equivalent  to 

^-^  >  3/4.   Also  recall  that  (41)  is  tantamount  to  q  >   en  ^     fo"" 
^  n  — 
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some  z   >  0   and  all  n  >  1  .   Hence  if  X  e  ^   for  some  1  <  p  <  3/2  and 

—  fVp  —    — 

3/4 
if  (41)  holds,  then  c  >^  en    for  some  e  >  0  and  all  n  >_  1  which 

2/3 
contradicts  c  =  n   ,  n  >  1.   Thus  the  hypotheses  of  Theorem  3.3 
n  — 

cannot  be  satisfied.  Q 


Example  3.2.   Let  (x,  X  ,  n  >_  1  }  be  i.i.d.  mean  zero  random 
variables.   Let 


if  n  is  odd, 


a 
n 


n 


if  n  is  even, 


and  b  =  n,  n  >  1 .   Then  the  hypotheses  of  Theorem  3-3  hold,  but  the 
n       - 

hypothesis  (5)  (with  q  =  2)  of  Corollary  3.2  fails. 

Proof.   Clearly  (41)  holds  with  p  =  1.   Likewise  (42)  obtains  since 

n 

E  la,  I  <  n  =  0(b  ).   Note  that 
k  =  1   ^  - 

if  n  is  odd, 


c 
n 


2 
n       if  n  is  even- 


To  show  that  (5)  fails  when  q  =  2,  let 


113 


d.   = 

J 


1  .^    ■    ■        .. 

—  if  J    IS  odd, 

J 


if  j    is  even 


and  e.    =  — ,    j    >_  1  •      Also,    let  n     satisfy 
^       j 


j^  >   2(j+l)^  for  j    >   n^. 


Now,    if  j   >   n   ,    then 
—     o 


12           1                   1 
d.    +   d.    .    >  5  >  ^  >  ^  +  ^  =   e^    +   6^  + 


m  00 

Therefore  Z  d.  >   Z  e.  obtains  for  all  n  >  n  .   Thus,  for 
1  —     J  —  o 

j=n  ^   j=n  ^ 

n  >  n 
-  o 


max  c^  Z  ^  >  (n-1)   Z  d. 
Kk£n   j=n  c.         J=n 


U  4     1 

>  (n-1)   Z  e.  =  (n-1)   Z  -^ 

j=n  ^         j=n  j^ 


4  2 

>  ^""j,^   =  (1+0(1))^  ^  0(n), 
2n 


which  shows  that  (5)  fails  when  q  =  2.  D 


1U 


These  two  examples  verify  the  assertion  that  these  results  stand 
on  their  own.   From  Theorem  3.3  we  obtain  a  few  immediate 
corollaries. 


Corollary  3- 6-   Let  {x,  X  ,  n  >^  1  }  be  i.i.d.  ^  random  variables  for 

some  1  <  p  <  2  where  EX  =  0.  If  la  ,  n  >  1 1  and  lb  ,  n  >  1 }  are 

-  '  n    -  '     '  n    -  ' 

constants  where  |a  |  +,  0  <  b  t  «=,  and  (42)  holds,  then  (^3) 
obtains. 


Proof.   In  view  of  Theorem  3.3  we  need  only  show  that  (41)  is 

satisfied.   Since  |a  j  +,  we  have 

'  n' 


^  |a  I    ^n|a  I 
2   '  n'     2   '  n' 


n    — r —  =  n 


b     "      b 
n  n 


n 

<  n  ^  ^^^. =  n  ^  0(1)         (by  (42)) 

n 


=  0(1 )  (since  1  <  p  <  2) , 

which  establishes  (41).  D 

This  next  corollary  was  obtained  by  Fernholz  and  Teicher  (1980) 

Corollary  3.7  (Fernholz  and  Teicher,  1980,  p.  769).   Let 

JX,  X  ,  n  >_  1  }  be  i.i.d.  r-andom  variables  with  EX  =  0  and  let 

r        1  " 

(a  ,  n  >  1  I  be  positive  constants.   Set  A  =  E  a   n  >  1    If  ^or 

"    -  "   k=1  ^    -  ' 
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some  6  >  0 


then 


na  . 

-^  =   0((log2A^)'*),  A^  ^  »  (49) 

n 


n 
-^ -y   0   a.s.  (50) 


A^dog^A^)' 


Proof.   Let  b  =  A  (log_A  )  ,  n  >  1,  and  p  =  1.   Hence,  via  Theorem 
n    n    2  n      - 

^n      -1       " 
3.3,  we  only  need  to  verify  that  —  =  0(n   )  and  I  a  =  0(b). 

n  k=l 

Observe  that 


na       na 

"        "     =  0(1)       (by  (49)) 


\       A^(logA)' 


and 


n 

^  \  A 

k=1  ^  n  1 


\         A^dog^A^)'    (log^A^)' 


0(1) 


since  0  >  0.  D 

Clearly  we  can  weaken  the  hypothesis  (49)  of  Corollary  3.7  and 
still  obtain  a  strong  law  (but  with  faster  growing  norming 
constants) . 
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In  Corollary  3.6  we  realized  that  if  we  assume  |a  |  •^  then  (42) 
implies  (41)  for  any  1  _<  p  <  2.   This  next  corollary  looks  at  the 
reverse  implication.   It  shows  that  if  p  =  1  and  |a  |  t  then  (41) 
implies  (42). 

Corollary  3.8.   Let  {x,  X,  n>_l}  bei.i.d.  mean  zero  random 

variables.   If  la  ,  n  >  1  1  and  lb  ,  n  >  1 1  are  constants  such  that 
^  n    -         n    - 

0  <  b  t  ",  la  I  +,  and 
n      '  n' 


na  =  0(b  )  (51) 

n      n 


then  (43)  holds. 


Proof.   Apply  Theorem  3-3  with  p  =  1  and  note  that  (41)  reduces  to 
(51).   Thus,  we  need  only  verify  (42).   Since  |a  |  + 


n 

.  _. '  k'    n|a  I 

^^^ <-— ^  =  0(1)       (by  (51)) 

D    —   b 
n       n 


establishing  (42). Q 

We  conclude  this  section  with  a  theorem  that  utilizes  a  result 
from  Chapter  2.  More  specifically,  we  will  use  a  fact  about 
regularly  varying  functions  in  our  quest  for  a  strong  law. 

Theorem  3.4.   Let  Ix,  X  ,  n  >  1  I  be  i.i.d.  mean  zero  random  variables 
n    - 

with  P{|x|  >  x}  regularly  varying  with  exponent  p  <  -1 .   Let 


117 


{a  ,  n  >  1  }  and  (b  ,  n  >  1  }  be  constants  such  that  0  <  b  t-  ^   and  (5) 
n    -        n    -  n 

holds  with  q  =  2.   Then 


n 

Z  a,  X, 

r ->■  0    a.s, 

D 

n 


iff 


E  P  X  >  c   <  ". 
,   '  '     n 
n=1 


Proof.   The  necessity  direction  is  immediate.   For  note  that  if 
n  >  2, 


n       n-1 

I   ,,  I     Z  a,  X,  ~  Z  a,  X, 
a  X     ',  ,  k  k   ,  ,  k  k' 
n  n'    k=1       k=1 


b  b 

n  n 


n         n-1 

'  ^  Vkl     I  ^  \\i 

k=1         ^    k=1  ^  "      ^ 

<  r +  r ■>  0   a.s. 

—     b         b   , 
n         n-1 


'  r 
c 


Therefore  P{ — —  >   1  i.o.  (n)}  =0  whence  Z  P{lx|  >  c  }  < 
n  n=1 


follows  from  the  Borel-Cantelli  lemma. 

To  prove  the  sufficiency  half,  note  by  Theorem  3.1  and  the 
independence  hypothesis  that 
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n 

I   a,  (X,  -EX,  KjX,  I  <  c,  )) 
k  k   k   '  k'  -  k 

!^ ->  0   a. 3.  (52) 


Next,  we  will  verify  that 


"  ^k 

Z  -^EXI(|X  I  <  c  )    converges.  (53) 

,   ^  D ,    K      K        K 

k=1   k 


By  Lemma  2.5,  for  all  k  >  some  k 


E|X|I(|X|  >  c,  )  <  CC,P{|X|  >  c  }.  (54) 


Then 


00    a 

k  =  1   k 


I     ^|EXI(|X|  <  c^)| 

k  =  1   k 


Z  — |EXI(|x|  >  c  )|  (since  EX  =  0) 


k  =  1    °k 


<      ^     ^E|X|I(|X|    >   c^) 
k  =  l      k 


k 

I     ^E|X|I(|X|    >    c^)    +        I  ^E|X|I(|X|    >   c^) 

k=l      k  k=k   +1      k 

o 
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k 

o  <» 

<  E  — E|X|  +  C  I   P{|X|  >  c  }      (by  (54)) 
k=1   k       k=k  +1        ^ 

0 


<  "  (by  hypothesis) 


thereby  proving  (53).   Then  by  the  Kronecker  lemma, 


?a^EX^I(|xJ  <  c  ) 

--^ 5 ^°- 

n 


Combining  this  with  (52)  yields 


I   a,  X, 

k=1  '  "        , 

^ ^  0   a.s.  D 

n 


What  will  prove  to  be  most  interesting  is  an  example  that 
compares  Theorem  3.-'^  and  Theorem  2.2.   We  will  establish  a  GCLT  and  a 
GSLLN  for  the  same  sequence  of  i.i.d.  random  variables  with  infinite 
second  moment.  This  will  be  done  in  Section  3.6. 

3.5  The  Petersburg  Game 
Throughout  this  section,  we  will  adopt  the  notation 

n 

S  =  Z  S|.^|.'  n  _>  1  ,  where  (a  ,  n  >^  1  }  are  constants  and  the  random 

1  _  1  ^ 

variables  fx,  X  ,  n  >  1 |  are  i.i.d. 
n    -  ' 


120 


This  section  examines  the  Petersburg  game.  The  idea  behind  this 

n 

game  is  to  find  a  sequence  {m  ,  n  _>  1  }  so  that  Z  ^|./™  converges  In 

k=1 

some  sense  to  1.   According  to  the  (classical)  Kolmogorov  SLLN,  if 

n 

(x,  X  ,  n  >  l}  are  i.i.d.  '^  random  variables  then  I   X  /n  ■*   EX 
"  1  k  =  l  "^ 

a.s.;  the  problem  that  arose  was  what  could  be  done  if  E(x|  =  <=. 

This  game  occurs  most  naturally.   The  random  variable 

X  represents  the  winnings  from  the  n   play  of  a  particular  game. 

The  sequence  {m  ,  n  >^  1  }  represents  the  total  accumulated  amount  of 

money  spent  playing  the  game  n  times.   Hence  a  player  should 

pay  m  -m  _.  ,  n  >_  1  (where  m^,  =  0),  for  the  n   play  of  the  game. 

Thus  if  E|x|  <  "  and  EX  *  0,  we  realize  that  the  player  should  pay 

the  fixed  entrance  fee  EX  for  each  play  of  the  game  in  order  for 

n 

Z  X,  /m  ->  1  a.s. 
k  =  1  ""     " 

Clearly,  by  the  converse  to  the  Kolmogorov  SLLN,  if 

e|x|  =  ",  then  for  any  fixed  entrance  fee  c,  a  strong  law  must  fail, 

i.e. , 


n 

^  \ 

P|lim  — —  =  1  }  =  0. 
^      en     ' 


Chow  and  Robbins  (1961)  improved  on  this.   They  established  that  if 
|x,  X  ,  n  >  l}  are  i.i.d.  random  variables  with  eIxI  =  «>,  then 
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n 

^  \ 
P{lim  — —  =  1  I  =  0  (55) 

n-»-"    n 


for  all  sequences  of  constants  {tn  ,  n  >  l}.  This  shows  that  if 
E|x|  =  »,  then  there  is  not  even  a  variable  entrance  fee  that  makes 
the  game  fair  in  the  "strong  sense."  Equation  (55)  was  first  proved 
by  Khintchine  (1935)  for  {x  ,  n  _>  1  }  i.i.d.  nonnegative  random 
variables  whose  common  distribution  function  is  continuous.  By 
imposing  a  few  minor  restrictions  on  the  weights  |a  ,  n  >_  1  }  we  will 


show  that  if  E|x|  =  ",  then 


S 

P{lim  -2  =  1}  =  0  (56) 


m 
n-*-"  n 


for  all  sequences  {ra  ,  n  >^  1  } .  Before  proving  (56),  we  need  to 
establish  a  result  that  is  an  extension  of  Theorem  2  of  Feller  (19'^6) 
to  the  weighted  i.i.d.  case. 

Theorem  3.5.  Let  |x,  X  ,  n  >  1 }  be  i.i.d.  random  variables.  Let 

I  a  ,  n  >^  1  }  and  {b  ,  n  >^  1  }  be  sequences  of  constants  where 

0  <  b  +  »,  c  +, 
n      n 


c  /n  ->■  °>,  (57) 

n 


n 

Z  |a  I  =  0(n|a  |),  (58) 

k=l   ^        " 


and 
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c      c . 

—  <  M  -r^    for  some  M  >  0  whenever  j  >  n  >  1.  (59) 

n  -   J  ^  -   - 


Then 


S 

TT-  ^  0       a.s.    iff    E  P{  Ixl  >  c  I  <  0°. 
b  '  '  '    n' 

n  n=1 


Proof.   The  necessity  half  of  this  theorem  is  immediate  (see  the 
proof  of  Theorem  3.^). 

We  will  now  prove  the  sufficiency  half.   With  a  little  help  from 
Theorem  3.1  we  will  obtain 


n 

Z  a  (X,  -EXKlxl  <  c,  )) 

^^ g ^  0   a.s.  (60) 

n 


as  follows.   Let  M  =  D^  =  D^  =  D  =  1  .   Hence  (13)  and  (14)  hold, 
whence  we  only  need  to  verify  (5)  with  q  =  2  in  order  to  establish 
(15).  Using  (59)  we  see  that 


2      1      2      1      2  2      1      2  2   1 

max  c,   I  -^  =  c   I  -^  <  M  n   I  "4  =  M  n  O(-)  =  0(n). 
1,,  .K.    2    n.    2—      .    .2         n 
1<k_<n   j=n  c      j=n  c        j=n  j 

Therefore,  via  Theorem  3-1,  we  obtain  (15)  which  by  independence  is 
tantamount  to  (60). 
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Next,  we  need  to  show  that 


n 

I  a  EXI(  Ixl  <  c,  )  =  o(b  ).  (61  ) 

k=1 


The  conditions  (57)  and  (58)  ensure  that 


n 

/  '^k'   Cnla  I   ^ 
k=1      ,        '  n'    Cn 


<  -—^  =   —  =  0(1).  (62) 

D     —    D        C 

n       n      n 


Also,  since  c  t,  setting  c  =  0, 


J 


^  jPiCi  1  <  1^1  <  C.I  =  E  I   Pic  .  <  |X|  <  c 

j=1   J  '       J   j=l  1<=1   J        J 


00        09 


=   Z   Z  Pic    <  |X|  <  c  }  =   Z  Pi|X|  >  c 
k=1  j=k   -^  ^         ^         k=1        ^   ' 


<  1+  Z  p1|x|  >  c  }  <  0°  (63) 

k=1        ^ 


by  hypothesis.  Utilizing  (59)  and  c  =  b  /la  j,  we  obtain 

n    n  '  n' 

c.    Mb 

-A-  <   — 1 r  whenever  n  ^  J  >.  1  c*  equivalently, 

'  n' 


Ir  <  -r^ —      for  n  >  j  >  1.  (64) 

b-nac.  -- 

n    '  n'  J 
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Then  for  all  choices  of  n  >  N  >   1 , 


i-l    Za^EXKlxl    <c^) 
n  k=1 


1        " 

°n  k=1      '^  ^ 


1        " 
<  ^     ^    I\|E|X|I(|X|    <   c   )  (since   c     O 


^     I    |ajE|x|l(|x|    <   c^)    ^  i-     Z    |ajE|xil(c^   <    |x|    <   c^) 
n  k=l  n  k=1 


en  n  "       1 

<  r-     I    |a    I    +      E    |a    I       Z        — E|X|I(C  <    \x\    <   c    ) 

n  k=1      ^         k=l      "  j=N+l      n  ^    '  ^ 


n  k=l  k=l  J=N+1       '    n'    J  ^  ^ 


n 

^  ^k       n 

^n  k=l      ^  "l^nl    j=N+l  ^   ^  ^ 


en  n 

<  r^     Z    |a,  I    +  C     Z     jP|c._.    <    |x|    <   c.j  (by   (58)) 

°n  k=l      ^  j=N+1  J    '  J 
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c..  n 


<  -^  Z  |a  I  .  C  Z  jP{c    <  |X|  <  c  } 
°n  k=1   *<     j=N    J  '         J 


First  letting  n  ^  «>  shows,  via  (62),  that  the  first  term  is  o(1). 
Then  letting  N  ^  "  shows  that  the  second  term  is  o(l)  since  it  is  the 
tail  series  of  a  convergent  series,  recalling  (53). 

Hence  (51)  prevails  which  when  combined  with  (60)  yields  the 
desired  result.  D 

Remark.   The  motivation  behind  Theorem  3-5  came  from  Theorem  2  of 
Feller  (19^+6).   Consequently,  we  may  now  obtain  Feller's  Theorem  2  as 
an  immediate  corollary  but  this  has  already  been  done  (see  Corollary 
3.1(iii)). 

This  next  corollary  will  play  an  integral  role  in  proving 
Theorem  3.7. 

Corollary  3.9.   Let  {x,  X  ,  n  >  l}  be  i.i.d.  random  variables  and  let 

{a  ,  n  >  1 }  and  {b  ,  n  >  1  }  be  constants  satisfying  0  <  b  +  «, 
n—         n-  J      a  i^> 

c  /n  t  00^  and  (58) .  Then 


S 

^  -►  0   a.s.   iff    Z  P||X|  >  c  }  <  ". 
n  n=l        " 


Proof.   Since  c  /n  +  ^,  the  conditions  c  t,  (57),  and  (59)  all 
n  n 

obtain.   The  corollary  follows  immediately  from  Theorem  3.5.  D 


Remark.   It  is  clear  that  if  la  I  +,  then  (58)  is  automatic. 
1  f^i 
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This  next  corollary  is  quite  similar  to  Corollary  3.8.   There 

is,  however,  a  trade-off  of  hypotheses.   We  no  longer  assume  EX  =  0, 

but  instead  replace  (51)  by  the  stronger  condition  c  /n  -^  <=. 

n 

Corollary  3-10.   Let  |x,  X  ,  n  >  1  I  be  i.i.d.  random  variables.   Let 
n    -  ' 

{a  ,  n  >  1  }  and  {b  ,  n  >  1  }  be  constants  such  that  0  <  b  t  oo, 

la  I  +,  and  c  /n  +  ».   Then 
'  n'        n 


S 

■r^  ^  0   a.s.   iff    E  P|  I  xl  >  c  }  <  ». 
b_,  1        n' 

n  n=1 


Proof.   The  corollary  follows  immediately  from  Corollary  3.9  and  the 
prior  remark.  □ 

To  accomplish  our  main  goal  of  this  section,  namely  Theorem  3.7 
and  (56),  we  need  a  few  preliminary  lemmas.   The  first  one.  Lemma 
3-7,  is  in  Chow  and  Bobbins  (1961),  but  a  simple  proof  is  given  here. 


Lemma  3- 7.   Let  {x,  X  ,  n  >_  1  }  be  i.i.d.  random  variables.   Suppose 

0  <  c  /n  t  for  some  a  >  0. 
n 


X 

(i)   If  I   P{|X|  >  c  }  <  ",  then  lim  —  =  0  a.s. 

n  0 

n=1  n-»'«'  n 

|X  I 
(ii)   If  I   P{|X|  >  c  }  =  »,  then  lim  sup  — —  =   »  a.s. 
n=1  n^"     n 


Proof.   (i)   Assume  Z  P{  |  x|  >  c  }  <  <».   Thus  by  Lemma  3.6  we  obtain 

n=1 

09 

Z  P{|x|  >  Ac  }  <  "  for  all  a  >  0,  whence  by  the  Borel-Cantelli 
n=1 
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lemma,  p{ >  A  i.o.  (n)}  =0  for  all  X  >  0.  Then,  by  considering 


c 

n 


the  complementary  event, 


P{ — —  <   A  eventually  (n)}  =1    for  all  A  >  0.        (65) 
n 


Thus 


P{lim  sup  -^   =  0}  =  P{  n  Clim  sup  -^   <  ^] } 
n-»-oo     n         M=1   n-*"     n 


lim  Pflim  sup  -^  <   ^} 


|XJ    ^ 
>_  lim  P{ _<  -  eventually  (n)} 


M^oo     n 


=  1  (by  (65)) 


f         n     1 
Hence,  we  obtain  P{lim  sup  =  0}  =  1,  which  is  tantamount  to 


c 
n->-<»     n 


X 

Pjlim  —  =  O}  =  1 


c 
n-*-"  n 


(ii)  Suppose  that  E  P{|x|  >  c  }  =  ».   This  time  we  conclude, 


n=1 


via  Lemma  3-6,  that  I  pllxl  >  Ac  }  =  «  for  all  A  >  0.   Then  by 

Ml         ^1 


n=l 
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the  Borel-Cantelli  lemma 


P{ — —   >  A  i.o.  (n)}  =  1    for  all  X  >  0.  (66) 


c 
n 


Therefore 


|X  I  «  |X  I 

P{lim  sup  — —   =  <»}  =  pID  Llim  sup  — —   >  M] } 
n->»     n  M=1    n-*'"     n 


X 


=  lim  pflim  sup  >_  m} 


>  lim  P{— ^  >  M  i.o.  (n)}  =  1         (by  (66)) 


thereby  proving  the  lemma.  D 

Lemma  3-8.   Let  (X,  X  ,  n>^l}  be  i.i.d.  random  variables.   Suppose 

{a  ,  n  >  1 }  and  |b  ,  n  >  1  I  are  constants  such  that  b  >  0, 
n    -  '     '  n    -  n 

00 

b  =  0(b  ,),  and  c  /n"  t  for  some  a  >  0.   If  Z  P{|x|  >  c  }  =  », 
n     n+1       n  ''  '    n 

n=1 

|S  I 
then  lim  sup  — —  =  "  a.s. 
n->'"     n 

|X  I 

Proof.   Using  Lemma  3.7(ii),  we  obtain  lim  sup  =  ■»  a.s.  where 

n-*"     n 

0  =b/|a|,n>1.   Thus,  for  n  >  2 
n    n  '  n'    -  — 
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whence 


n       n-1 
I   a  X  -  I 
V'n'    k  =  1  ^  ^   k  =  1 


|X  I    |a  X  I    'iVk  "  ^^Vkl 

In'      Inn'       1^  =  1  L'  =  1 


c               b 
n                n 

b 
n 

n 

n-1 

I  a,  X, 

+ 

Vi 

k=l    '^   ^ 
\-1      ' 

n 


l^nl  ... 


I.^.Vkl 


lim  sup  <  lim  sup 


c   -      '^  b 

n-^oo     n     n-*-"       n 


n-1 

,  n-1  V    , .       k  =  1 
+  lim  sup(-r — )  •  lira  sup 


b  '    '     ■--.         jj 
n-*"     n      n^«>      n-1 


n  n—  1 

(lim  sup  — — )(1+lim  sup(— r — )) 

n^oo     n      n-*"     n 


l^nl 

Since  lim  sup  =  "  a.s.  and  b  ,  =  0(b  ),  the  result  follows.  □ 

^  c  n-1      n 

n-*-"     n 

Combining  these  last  two  lemmas  and  Corollary  3-9  yields  the 

following  lemma. 


Lemma  3-9.  Let  Ix,  X  ,  n  >  1  f  be  i.i.d.  random  variables.   Let 

n    - 

la  ,  n  >  1  I  and  lb  ,  n  >  1  1  be  constants  with  0  <  b  t  ==>  and 
^  n    -  '     '  n    -  '  n 

c  /n  +  <». 
n 


130 


n  <*> 

(i)   If  I    |a  I  =  0(n|a  |)  and  E  p{|x|  >  c  }  <  «,  then 
k=1   ^        "      n=l        " 


X        S 

,  .   n  ^  .   n   „ 

lim  —  =  lim  :;— ■  =  0   a.s. 

c       b 

n-vco  n  n-*-""  n 


(ii)   If  E  PJIxl  >  c  }  =  ",  then 
'  '  '    n 
n=1 


T  ■      '  n'  ,  .      '  n' 

lim  sup  =  lim  sup  -- —  =  ==   a.s. 

c  "^  b 

n->-"=     n      n-*""     n 


X 

Proof,   (i)   Lemma  3.7(i)  shows  that  lim  —  =0  a.s.,  while  on  the 

n^"  n 

S 

other  hand  Corollary  3.9  demonstrates  that  lim  r^  =  0  a.s. 

b 
n^"  n 

(ii)  This  half  of  the  lemma  follows  from  Lemma  3.7(ii)  and 

Lemma  3.8  since  b  +  implies  that  b  =  0(b  ,).n 
n  n      n+1 

Lemma  3.9  allows  us  to  prove  the  following  theorem. 


Theorem  3-5.   Let  (x,  X  ,  n  >_  1  |  be  i.i.d.  random  variables.   If 

{a  ,  n  >  1 }  and  fb  ,  n  >  1 1  are  constants  such  that  0  <  b  +  », 
n    -  '     '  n    -  '  n 

n 

I    |a|  =  0(n|a  |),  and  c  /n  +,  then 
k  =  1   "^        "        " 

|S  I 
P(0  <  lim  sup  -~-   <  "}  =  0. 
n^"     n 


|X^| 

Moreover,  if  p{lim  sup  <  <»}  >  0,  then 

n-*-"     n 
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S 
lira  T—  =  0   a.s, 

D 


Proof.   Note  that  if  Z  P{ | x|  >  c  }  =  «,  then  via  Lemma  3.9(ii) 

n=1        " 


P{0  <  lira  sup  -~-  <   "} 


<  P{lira  sup  —^   <  «>}  =  0. 


On  the  other  hand  if  E  P(|x|  >  c  }  <  »,  then  via  Lemma  3.9(i), 

n=1 
S 
lira  —  =  0  a.s.   Therefore, 
n->-«'  n 


P{0  <  lira  sup  -— -  <  "=}  =  0 
n-*-"     n 


and  the  first  part  is  proved. 

|X  I 

r          n     1 
Moreover,  if  Pjlim  sup  <  "j  >  0  or,  equlvalently, 

n-*-"     n 

|X  I 
r         n     ) 

Pllim  sup  =  "I  <  1  ,  then  by  the  contrapositive  statement  of 

n^"     n 

00 

Lemma  3-9(ii)  we  obtain  I  p{  I  x!  >  c  1  <  °°.   Also  since 

,   '  '    n 

n=1 

n  S 

Z  |a  I  =  0(n|a  |),  Lemma  3.9(i)  ensures  that  11m  r^  =  0  a.s.D 

ki   K        n  u 

=1  n^*"  n 
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We  are  now  ready  to  prove  our  principal  result  of  this 
section.   It  generalizes  some  work  of  Chow  and  Robbins  (1961)  and,  as 
will  become  apparent,  its  proof  owes  much  to  their  work. 

Theorem  3.7.   Let  (x,  X  ,  n  >  1  t  be  i.i.d.  random  variables  and 

{a  ,  n  >^  1  }  a  sequence  of  constants.   If  E|x|  =  =», 

n 

I  |a  I  =  0(n|a  |),  and  n|a  |  +  then  for  each  sequence  of  constants 
k  =  1   "^        n  n 

Im  ,  n  >  1  }  either 
n    -  ' 

^n  ^ 

lim  inf  I — I  =  0  a.s.   or       lim  sup  I — I  =  «=  a.s. 

n-*<»    n  n*"     n 


Proof.  We  can  trivially  rule  out  the  case  when  m  =  0  for  infinitely 
many  n.   Assume  that  the  conclusion  fails.   Then  there  is  some 
sequence  (m  ,  n  >_  1  }  such  that 

S  S 

Pflim  inf  |— |  =  o}  <  1   and   P(lim  sup  |  — |  =«■}<!     (67) 
n-*-"     n  n-*""     n 


or,  equivalently, 


S  S 

P(lim  inf  1  —  1  >  o}  >  0   and   P{lim  sup  I  — I  <  «>}  >  0, 
n-*"     n  n^<»     n 


Firstly,  suppose  that  m  =  0(n  a  ).   Then  since 

n      '  n' 

S  S 

P{lim  sup  I  —  I  <  "I  >  0,  we  must  have  pflim  sup  I 1  <  «=}  >  0. 

n-*'°  n  n-*-"     n 


S 
Therefore  p(lim  sup  |-^|  =  «■}  <  1 


'na 
n-*-"      n 
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Next,  we  verify  the  hypotheses  of  Lemma  3-8  with  b  =  nla  1.   So 

n    '  n' 

c  =  b  /la  I  =  n.   Hence  c  /n  t  for  some  ct  >  0  is  satisfied  and 
n   n  '  n'  n 

b  =  0(b  ^.)   since  b  =  nla  I  t.   Utilizing  the  contrapositive  of 
n      n+i        n    '  n' 

03 

Lemma  3.8  we  may  conclude  that  E  P{|x|  >  c  I  <  <».   Since  c  =  n, 

.   '  '    n'  n 

n=1 

00 

we  have  shown  that  Z  P{|x|  >  n}  <  «  which,  via  (11),  is  tantamount 

n=1 

to  E|x|  <  "  and  this  contradicts  the  hypothesis  e|x|  =  ». 

Alternatively,  suppose  that 


m 


lim  sup  I 1  =  ">.  (68) 


na 
!!->•"      n 


"k 


Let  d  =  n  max  \- — |,  n  >  1.  Note  that 
"    1<k<n  % 


111  in 

d     >  n|-^|    =    1^1.  (69) 


d  mm 

Since  —  =     max    ||^|    >    | 1    and   (59)    holds,    we  can  conclude  that 

1<k<n   k      n 


d 

0  <  —  t  00.  (70) 

n 


m      m 

It  will  now  be  shown  that  max  \- — |  =  | 1  for  infinitely  many 

1 < k£n   k      n 

n.   Suppose,  to  the  contrary,  that  the  last  term  is  the  maximum  for 

only  finitely  many  n.   Then  there  is  an  integer  N  such  that  for  every 

n  >  N  there  is  some  k  <  n  where 
—  n 
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k  m,      m 

\- =  max  \- >  

k  a,  '  ,  .,  .  'ka  '    '  na  ' 

n  k  1 <k<n   k      n 

n     


Note  that 


Vi    ,   .  .'"k  ,  ,\ 


<   max   It"^^— 1  =  max 


(N+1  )a„   '    ,  ^,  ^„  ,  ka,  '    ,  ^,  ,.,  ka, 
N+1    l<k<N+1    k    1<k<N   k 


"k 


Likewise 


m.,  ^„  m,  m, 

I  ,    . 1  <   max  \- — I  =   max  \- — | 

^^*'^^V2    1<k<N+2  ^^k    l<k<N+1  ^\ 


tn, 

I  k  I    I    N 
max 


l<k<N  ^\     "^N^,, 


Continuing  this  argument  we  see  that  for  every  n  >  N 


J  nil 

d        m,        k., 
n       I  k  I    I   N  I  ^ 

—  =  max  l] =  \-, <  «> 

n        '  ka  '    '  k  a   ' 
1<k<n   k      N  k„ 


thereby  contradicting  (70).   Thus,   max  |-; 1  =  | 1  for  infinitely 

1  _<k_<  n   k      n 

many  n. 
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Consequently,  there  is  a  subsequence  {d  ,  j  >_  1  I  with 


m       m 
n .       n . 


n.    J ' n .a  '    'a 


Note,  via  (69),  that  d  la  I  >  Im  I  and  hence 

n'  n'  -  '  n' 


S  S 

P{lim  sup  \-~-\  <  »}  >  PJlim  sup  1  —  1  <  «>}  >  0. 
'da'      —  'm' 

n->«>     n  n  n-*-"     n 


Next,  we  will  apply  both  parts  of  Lemma  3.9  to  obtain 

S 

lim  - — I   I  =  0  a.s.  as  follows.   The  norming  constants  are  now 
n-*"  n'  n' 

b  =  d  la  I,  n  >  1,  whence  c  =b/la|=d,n>1.   Then 
n    n'  n'    -  n    n  '  n'    n    - 

0  <  c  /n  t  co^  recalling  (70).   Also  we  need  to  verify  that 

0  <  b  +  ".   Now 
n 


b  =  d  I  a  I  =  n I  a  I  max  ' 


n    n'  n'     '  n'  .,  ,  '  ka ,'  ' 

1 <k<n   k 


and  so  b  t  since  n  a   +  by  hypothesis.  To  show  that  b  -►  «>, 
recalling  (68)  and  again  using  the  fact  that  n|a  |  +,  we  see  that 
lim  sup  |m  I  =  «>.   Now 

m  m 

b  =  nla  I  max  1^ 1  >  nla  11 1  =  Im  |, 

n    '  n'  ^,  ,  'ka  '  -   '  n '  '  na  '    '  n' 
1 <k<n   k  n 


and  so  lim  b  >  lim  sup  m   =  ». 
n  -      ^  '  n' 
n-»-o>       n->-<» 
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S 
Since  we  have  p(lim  sup  \- 1  <  »}  >  0,  we  may  conclude  using 

G  a. 

n>«>     n  n 
the  contrapositive  of  Lemma  3.9(ii)  that 


Z  P  X  >  d   =  E  P  X  >  c   < 
'  '  '    n      ,        n' 
n=1  n=1 


n 

Finally,  note  that  since  I  |a  |  =  0(n|a  |)  we  obtain,  via  Lemma 

1<  =  1      ^  " 

S 

3.9(i),    that  lim   ,    i"   r  =  0  a.s. 
da 
n>oo     n'    n' 

S 
n. 

Therefore  lim  - — r^ r  =  0  a.s.   Since  d   la   I  =  Im   I,  j  >  1, 

da  n.'n.'    'n.'    — 

J-*"  n  '  n  I  J   J       J 

n .  S 

we  conclude  that  lim  I — ^1  =  0  a.s.   Thus  lim  inf  I  — I  =  0  a.s. 

'm  '  'm  ' 

J-+00   n.  n^<»     n 

contradicting  (67)  and  thereby  proving  the  theorem  under  case  (68). Q 
Using  Theorem  3-7  we  can  now,  under  the  appropriate  assumptions, 
conclude  (56) . 


Corollary  3.11.   Let  (x,  X  ,  n  >  1  }  be  i.i.d.  random  variables  with 
n    - 

eIxI  =  °>.   If  la  ,  n  >  1  }  is  a  sequence  of  constants  where 

n  S 

I  la,  I  =  0(n|a  1)  and  nla  I  t,  then  Pilim  —  =  c|  =  0  for  every 
,'k'      'n'       'n'         '    m     '  •' 

sequence  of  constants  (m  ,  n  >_  1  }  and  every  finite  nonzero 

constant  c. 

S 

Proof.   Since,  by  Theorem  3.7  either  lim  inf  | — |  =  0  a.s.  or 

'm  ' 

n->-<»     n 

S  S 

lim  sup  I — I  =  «>  a.s.,  there  is  zero  probability  that  lim  —  =  c.  □ 
'm  '  m 

n-»-a>     n  n-*<»>  n 
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Finally,  we  note  that  Theorem  3.7  and  Corollary  3.11  generalize 
the  results  of  Chow  and  Robbins  (1961). 


Corollary  3.12  (Chow  and  Robbins,  1961).   If  {X,  X  ,  n  >  1  j  are 

i.i.d.  random  variables  with  E|x|  =  »,  then  for  every  sequence  of 

constants  Im  ,  n  >  1  1  either 
^  n    - 


n  n 

EX  Z  X 

1-1  II 

lim  inf  I 1  =  0  a.s.   or   lim  sup  I 1  =  »  a.s. 

'   m  '  ^  '   m  ' 

n-»"»      n  n-*"      n 


Proof.   In  view  of  Theorem  3.7,  we  need  only  show  that 

n 

Z  |a|  =0(n|a  |)  and  n|a  |  +  hold  when  a  =1.   But  these 
,  J   K         o  n  n 

k  =  1 

conditions  trivially  hold,  whence  the  conclusion  follows.  D 


Corollary  3.13  (Chow  and  Robbins,  1961).   If  {x,  X  ,  n  >  1 }  are 

n 

k  =  l'^ 

i.i.d.  random  variables  with  eIxI  =  °=>  then  Pllim  =  c}  =  0  for 

'  '  '      m 

n-»-<»    n 


all  sequences  of  constants  {m  ,  n  >_  1  }  and  every  finite  nonzero 
constant  c. 


Proof.   This  follows  immediately  from  Corollary  3.12  or  Corollary 
3.11.  D 
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3.6  Examples 

In  this  section  we  give  a  few  examples  that  demonstrate  various 
results  of  this  chapter.  Moreover,  we  present  an  example  that 
compares  a  GSLLN  with  a  GCLT. 

The  following  example,  which  illustrates  Theorems  3.1  and  3.2 
and  Corollary  3.2,  has  less  restrictive  conditions  than  those  of 
Corollary  4  of  Teicher  (1985). 

Example  3.3.   Let  {x,  X  ,  n  >_  l}  be  identically  distributed  random 

variables  and  let  la  ,  n  >  1  I  and  lb  ,  n  >  1 }  be  constants  with 

n    -  '     '  n    -     ' 

0  <  b  t  «>.   Suppose  that  b  /la  I  =  (nL(n))   ^,  n  >  1,  for  some 
n        '^'^         n  '  n'  - 

0  <  p  <  2  where  L  is  a  positive  slowly  varying  function  such  that 
either 

(i)   L((xL(x))   ^)  =  0(L(x))  as  x  ^  =»,  x^/L(x)  is  eventually 

lx|P 

nondecreasing,  and  E  i ? ' i .  <  » 

H  I  A  I  ) 

or 

(ii)   lim  inf  L(x)  >  0  and  Ejxl'^  <  ». 

Moreover,  suppose  that  if  1  £  p  <  2  then  |x,  X  ,  n  >  1 }  are  . 
independent  with  EX  =  0.   Furthermore,  suppose  (28)  holds  if  p  =  1 
and  xL(x)  is  eventually  nondecreasing  if  1  <  p  <  2.   Then 


n 

k  =  1 

— -g ^  0   a.s.  (71) 

n 
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Proof.   Let  c  =  (nL(n))   ^,  n  >  1 .  We  will  firstly  show  that 

00 

E  PJIXI  >  C  }  <  ". 
n=l 

Under  (i),  there  exists  an  e  >  0  and  a  positive  integer  N  such 

that  for  all  n  >  N 


"^^"^      >  e  (72) 


L((nL(n))^^P) 


and 


xP/L(x)  t     for  X  >  N.  (73) 


Therefore, 


I  P{|X|  >  cj 
n=1 


C  +  I  P{|X|  >  (nL(n))^^P} 
n=N 


<  C  .  Z  P{^  >  "^^"\  -   }       (by  (73)) 

n=N  ^^1^1^    L((nL(n))^^P) 


1x1° 


-'^y^rftxiT'  '"^  ^'^  ^^'^^ 


<  "  (by  (11)) 


uo 


On  the  other  hand,  under  (ii),  there  exists  an  £  >  0  and  a 
positive  integer  N  such  that  for  all  n  >_  N 

L(n)  >  e  (74) 


Hence, 


Z  P{|X|  >  cj 
n=l 


C  +  I  p1|x|  >  (nL(n))^''Pj 
n=N 


<  C  +  Z  P||X|P  >  en}         (by  (74)) 
n=N 


<  ">  (by  (11)) 


Observe  that  via  slow  variation  of  L 


T   •  p  °2n   , .   .  ^  (2nL(2n))^^P 
litn  inf  =  lira  inf  -^^ ^^ ---, — 

n->«>    n      n->"    (nL(n)) 


=  2^/P>2 


whenever  0<p<1.      SoifO<p<l,    then  invoking  the  sufficiency 
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part  of  Lemma  3.5  with  q  =  1  and  r  =  2,  the  hypotheses  of  Theorem 
3.2(i)  are  satisfied  and  so  (71)  follows. 
Next,  observe  that 


2 

, .   .  ^  °2n   , .   .  ^  (2nL(2n))   P 
lim  inf  -^ir-  =  lim  inf  - 


2  .  , ,  . .2/p 

n-*-"   c      n^"   (nL(n)) 
n 


22/P  >  2 


whenever  0  <  p  <  2.   Then  for  any  0  <  p  <  2,  (5)  holds  with  q  =  2  via 
Lemma  3.5  with  r  =  2.   So  if  p  =  1,  (71)  follows  by  the  sufficiency 
half  of  Corollary  3.2. 

Finally,  suppose  that  1  <  p  <  2.   Note  that  since  xL(x)  is 
eventually  nondecreasing,  we  obtain  (16).  We  will  now  verify  (17). 
Since  xL(x)  is  eventually  nondecreasing,  there  exists  a  positive 
integer  N  such  that  if  n  >_  N  then 

nL(n)  t.  (75) 

Thus,  for  all  n  >  N+1 , 


n            1  /   "^ 
c„   I  ^  =  (nL(n))^^P   E 


"  k=l  ^k  k=l  (kL(k))^^P 


.  ,   N  n 

(nL(n))^^P  I — r^  +  (nL(n))^^P   I 


k=l  (kL(k))^''P  k=N+1  (kL(k))^^P 
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n 
<  C(nL(n))^^P  +  (nL(n))^''P/  ^-A^dx       (by  (75)) 


1  (xL(x))^''P 


p-1 


(by  Theorem  1 (b) 


<  C(nL(n))^'P  .  (Uo(l))(-^)(^)''P  n  ^      of  Feller,  1971. 

P-^    ^^")  p.  281) 


=  0(n)         (recall  1  <  p  <  2  and  L(x)  =  o{x^)    for  all  a  >  0). 

Thus,  (17)  holds  and  so  (18)  obtains  by  Theorem  3.1.   Then  (71) 
follows  by  independence  and  EX  =  EX  =  0,  n  >_  1.  D 

Remarks.   Note  that  the  function  L(x)  =  (log  x)   (where 

-00  <  a  <  oo)  clearly  satisfies  the  first  two  conditions  of  (i).   Thus 

we  have  generalized  Corollary  4  of  Teicher  (1985)  wherein 

a  =  n   P,  n  >_  1,  and  b  =  (log  n)   P,  n  >  1,  produce 

c  =  (nlog  n)    ,  n  >_  1  ,  in  his  first  part  (i.e.,  a  =  1)  and 

a  a+(l/p)  ^        1 /p 

a  =  n  ,  n  >  1  ,  and  b  =  n     *^  ,  n  >  1  ,  generate  c  =  n   , 
n        -        n  -  n 

n  _>  1  ,  in  his  second  part  (i.e.,  a  =  0) . 

It  should  also  be  noted  that  the  condition 
L((xL(x))   P)  =  0(L(x))  as  X  -»■  «>  for  some  0  <  p  <  2  is  not  automatic 
for  every  slowly  varying  function  L.   For  Rosalsky  (1987)  showed 
that  L(xL(x)  )/L(x)  •>  »  as  x  *  »  for  the  function 
L(x)  =  exp|(log  x)   log  x}. 

This  next  example  will  compare  results  from  this  chapter  and  the 
previous  one  by  reexamining  Example  2.2.  Notice  the  relative  freedom 
we  have  in  choosing  the  sequence  {c  ,  n  >_  1  } . 
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Example  3-^-     Let  {x,  X  ,  n  >  l}  be  i.i.d.  random  variables  with 
common  density  function 

|!(2ao£_ULM)         for  |x|  >  e, 


'  lx'3 


f(x)  = 


for  |x|  <  e. 


n 

Then  E  a,  X,  /b  ^-  0  a.s.  for  every  choice  of  sequences  {a  ,  n  >  1  } 
,  ,  k  k  n  n    - 

k  =  1 


and  ib  ,  n  >  1  }  provided  that  0  <  b  f-   ">   and  c  =  n   L(n)  -»■  for  some 
^  n    -  n         n 


0  <  p  <  2  and  positive,  slowly  varying  function  L. 

Proof.  We  have  already  shown  in  Example  2.2  that  EX  =  0  and 
p{|x|  >  s}  is  regularly  varying  with  exponent  -2.   So  recalling 
Theorem  3-^,   we  need  only  show  that  (5)  holds  with  q  =  2  and  that 

GO 

E  P{|x|  >  c  }  <  ".   It  is  clear  that  X  e  J^  for  all  0  <  r  <  2.   Let 
n=1 

0  <  e  <  TT^  and,  since  L  is  slowly  varying,  (L(n))    <  n"^  for  all 
2p 

n  >  some  n  .  Therefore 
—      o 


Z  P(|X|    >  c    }   =      I  P{|X|    >   n^^Un) 


n 
n=1  n=1 


1  -ep 

00  ~ 

<C+I     P||X|>n'^      }<«>  (by   choice  of  e   and   (11)) 


n=n 
o 
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Next,  observe  that 


2   V   1      2/p,.,  ,,2   ^       1 
max  c   E  -p  =  n  "^(LCn))   I     -^jz p 

l<k<n   j  =  n  c.  j  =  n  j  P(L(j))'' 


<  n^^P(L(n))^/    ^7—^ rdx 

n-1  x^^P(L(x))'^ 


(Uo(n)n2/P  ^(ill^ 


(L(n-l))2(2-p)(n-l)^2-P^/P 


(by  Theorem  1(a)  of  Feller  (1971),  p.  281) 
=  0(n)  (by  Lemma  2.9) 

thereby  establishing  (5)  with  q  =  2.  D 

Remark.   As  must  be  the  case,  the  sequences  in  Example  2.2  must  fail 

to  satisfy  the  hypotheses  in  Example  3.^.   Recall  in  Example  2.2  that 

a  =  L(n),  n  >  1,  where  L(x)  is  any  positive  slowly  varying, 
n  — 

nondecreasing  function  and  b  =  j/nL(n)log  n,  n  >_  1  .   Hence 


^nL(n)log  n 
°n  =  Vl^nl  = LOT) =  2^^°S  "'  "  ^  ^  ' 


1  /p  * 

does  not  satisfy  the  condition  that  c  =  n   L  (n)  t  for  some 

0  <  p  <  2  and  positive  slowly  varying  function  L  .  Moreover,  it  does 

not  satisfy  the  hypothesis  that  (5)  holds  with  q  =  2  since 
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2             1                             2                      1 
max  c       E     —  =   n(log  n)        Z ~  nlog  n  *  0(n) 

Kk<n       j  =  n  c  j  =  n  j(log  j) 


As  it  has  been  noted  throughout  this  chapter,  there  have  been 

many  studies  generalizing  the  SLLN.   One  such  investigation  by 

Rohatgi  (1971)  has  a  few  conditions  which  are  similar  to  some  of 

ours.   For  example,  Rohatgi  assumed  the  existence  of  a  stochastically 

dominating  random  variable,  but  instead  of  considering  the 

normalization  of  partial  sums  of  weighted  random  variables  he  studied 

n 
the  sequence  {  1   a  X  ,  n  >^  1  }  which  is  more  general  than  our 
k  =  1 
n 
{  I   a  X  /b  ,  n  >  l}.   Rohatgi 's  main  result  may  be  stated  as  follows. 
k  =  1 

Theorem  3-8  (Rohatgi,  1971).   Let  {x  ,  n  >  1 }  be  a  sequence  of 

independent  random  variables  with  eIx  I  <  «>  and  EX  =  0  for  n  >  1  and 

'  n'  n  — 


satisfying  for  some  random  variable  X 


P{|X  I  >  x}  <  P{|x|  >  x}   for  all  X  >  0,  n  >  1.         (76) 


Let  {a  1^.  n  >^  1  ,  k  >^  1  }  be  a  double  array  of  constants  which  satisfy 


lim  a   =  0    for  all  k  >  1 ,  (77) 


and 


146 


Z  |a   I  =  0(1).  (78) 

'  nk ' 


k=1 


If 


max  |a   I  =  0(n  ^)    for  some  v  >  0,  (79) 

k>l   "^ 


and 


1.1 


e|x|   ^  <  <"  (80) 


then 


Z  a  ,  X,  ^0   a.s.  (81  ) 

nk  k 


k  =  1 


Proof.   See  Theorem  2  of  Rohatgi  (1971).  D 

It  is  natural  to  ask  if  a  result  as  fundamental  as  the  classical 

Kolmogorov  SLLN  follows  from  Rohatgi 's  work.   To  be  precise,  for 

Ix  ,  n  >  1  I  i.i.d.  mean  zero  random  variables,  is 
^  n    -  ' 

n 

Z  X  /n  ^  0   a.s.  (82) 

k  =  1  ^ 

a  consequence  of  Theorem  3.8?  The  Kolmogorov  SLLN  is  established  by 
many  of  the  results  of  this  chapter.   For  example  we  can  use 
Corollary  S.Ui)  or  (ii)  to  obtain  the  Kolmogorov  SLLN. 
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The  point  here  is  that  this  basic  SLLN  is  not  covered  by  Theorem 
3.8.   In  this  situation 

if  1  <  k  <  n, 
I  II 

\k 

if  k  >  n. 

Conditions  (76),  (77),  and  (78)  are  all  satisfied.  The  major 
drawbacks  to  Theorem  3.8  are  the  conditions  (79)  and  (80). 

Condition  (78)  states  that  1/n  =  0(n  ),  which  implies  that 

0  <  V  <  1.  On  the  other  hand,  (80)  states  that  E|X  |   ^  <  o-. 

This  means  that  for  (82)  to  hold  via  Theorem  3.8  we  need  X.  e  ^ 

1   *^p 

for  some  p  >_  2,  but  this,  as  we  have  seen,  is  far  too  stringent  a 
requirement. 

This  example  shows  the  inherent  competition  between  conditions 
(79)  and  (80).  Condition  (79)  is  weakened  when  v  is  small,  while 
condition  (80)  is  weakened  when  v  is  large. 

The  hypotheses  we  have  used  usually  have  reinforced  each 
other.  As  in  Example  3.^,  we  saw  that  c  =  n   L(n)  satisfies  both 

00 

(5)  with  q  =  2  and  L  P(  |x|  >  c  }  <  <». 

n=1 

A  comparison  between  Theorem  3-8  and  Corollary  3.2  deserves  some 

attention.   In  both  cases  we  have  independent  random  variables  with 

EX  =  0,  n  >  1 .   If  we  let 
n       - 
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hj/b         if  1  <  k  <  n, 


k'   n 

a  ,  = 

nk 

if  k  >  n, 

we  see  that  (77)  must  hold  provided  b  ->  <=,   It  is  clear  that  (78)  is 

n 

equivalent  to  (28).   Likewise  (79)  and  (80)  are  similar  in  spirit  to 
(5)  and  (30),  respectively. 

Finally,  we  will  end  this  section  with  an  example  that 
illustrates  the  differences  between  Theorems  3-2  and  3.8.  We  present 
a  nontrivial  example,  since  it  is  clear  that  (80)  fails  if  we  assume 
E I  X  I   =  »>  for  some  r  _<  1  . 

Example  3 •5.      Let  |x  ,  n  >  1  }  and  X  be  random  variables  such  that 

{|X  |,  n  >^  1 }  is  stochastically  dominated  by  |x|  in  the  sense  that 

there  exists  a  constant  D  <  «>  satisfying  (32).   Suppose  that 

e|x|-^''^  <  "  but  Ejxl'^  =  "0  for  r  >  3/2.   If  (a  ,  n  >  1  }  and 

{b  ,  n  >  1  }  are  constants  with  0  <  b  +  «>  and  c  =  n   ,  n  >  1  , 
n    -  '  n         n  —  ' 

n 
then  I  a,  X,  /b  ^0  a.s. 
k=1  '^  "^  " 

Proof.   In  view  of  Theorem  3-2  we  only  need  to  verify  (5)  with  q  =  1 

and  (33).   Condition  (5)  holds  since 


1  3/2      1      3/2-1 /2 

max  G,   Z  —  =  n^    E  -^  =  n^  0(n    )  =  0(n) 

■,   y,     y           ^         ■                 C  .  .3/2 

1<k<n   j=n  J  j=n  j 


Next,  observe  that 
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EP{|X|    >   DC    }   =      ZP{i|^>   n3/2} 


n=1  n=1 


CO 

<     I  pI^I-  >  n^^^}   <  «>  (by   (ID) 

n=1 


(83) 


and  hence  (33)  also  holds.  Q 

Remark.   First,  note  that  the  inequality  in  (83)  is  very  crude.  We 

can  easily  weaken  the  moment  condition  on  X  and  still  obtain  the 

desired  result.   Next,  note  that  we  are  not  assuming  that  the  random 

variables  are  independent  nor  that  EX  =  0,  n  >_  1 ,  as  in  Theorem 

3.8.   Also,  the  version  of  stochastic  domination  is  more  general  in 

Theorem  3.2  than  in  Theorem  3.8. 

Finally,  note  that  we  have  a  lot  of  freedom  in  choosing  the 

weights  {a  ,  n  >^  1  }  and  the  normalizing  constants  |b  ,  n  >^  1  } . 

For  example,  suppose  a  =  — ,  n  >_  1  ,  and  b  =  n,  n  >_  1  .   This  clearly 

"   /n 

3/2 
satisfies  0  <  b  +  «  and  c  =  n   ,  but  we  will  now  see  that  Theorem 
n         n 

3.8  fails  to  establish  the  GSLLN.   In  this  situation,  let 


if  1  <  k  <  n. 


if  k  >  n. 
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Fact.   Define  {a  ,  ,  k  >  1  ,  n  >  1  }  as  in  (8M).   If  Elxp''^  <  «>  but 

'  nk    -     -  '  ' 

eIxI""  =  "  for  r  >  3/2,  then  (79)  and  (80)  cannot  hold  simultaneously 
(in  this  example). 

1      -V 
Proof.   Condition  (79)  reduces  to  -  =  0(n  )  for  some  v  >  0  which 

n 

implies  that  v  <_  1  .   Next,  if  (80)  is  to  hold,  then,  in  view  of  our 

1    3 
moment  requirement  on  X,  we  have  1  +  -  ^  p  or  equivalently  v  >_  2. 

Thus  the  conditions  (79)  and  (80)  cannot  both  hold.  D 

This  example  shows  the  intrinsic  conflict  between  the  conditions 

(79)  and  (80). 


CHAPTER  FOUR 
A  GENERALIZED  WEAK  LAW  OF  LARGE  NUMBERS 


4. 1   Introduction 
The  purpose  of  this  chapter  is  to  propose  conditions  where  a 
Generalized  Weak  Law  of  Large  Numbers  (GWLLN)  obtains,  i.e., 


D 

n 


On  one  hand  our  job  in  some  sense  is  quite  easy,  while  on  the  other 

hand  it  is  very  difficult.   The  easy  part  comes  from  the  fact  that 

almost  sure  convergence  implies  convergence  in  probability. 

Therefore  all  the  GSLLN  results  in  Chapter  Three  are  also  GWLLN 

results.   So  it  will  be  our  goal  to  change  some  of  the  assumptions 

placed  on  the  random  variables  and  constants.  What  makes  our  work 

difficult  is  that  the  weak  law  has  been  developed  in  great  depth,  see 

Chow  and  Teicher  (1978,  p.  326-329),  or  Loeve  (1977,  p.  329).  To 

this  end,  we  will  strengthen  the  hypotheses  placed  on  the  random 

variables  |x,  X  ,  n  >_  1  }  while  weakening  the  conditions  imposed  on 

the  constants  {a  ,  n  >^  1  }  and  {b  ,  n  >  l}.   As  in  Chapter  Three,  set 

c  =b/|a|,n>1. 
n    n  '  n'    - 

4.2  Mainstream 
Our  major  result  in  this  chapter.  Theorem  4.1,  has  two 
motivating  factors.   The  first  part  of  Theorem  4.1  is  an  adaptation 
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of  a  result  of  Klass  and  Teicher  (1977)  to  the  case  where  the  weight 
sequence  {a  ,  n  >  1  }  is  not  constant.  Meanwhile,  the  other  half  of 
Theorem  4.1  is  a  refinement  of  Theorem  3  from  Chow  and  Teicher  (1978, 
p.  123-12iJ). 

Theorem  4.1 .   Let  {x,  X  ,  n  >  1  }  be  i.i.d.  random  variables.   Let 

fa  ,  n  >  1 }  and  {b  ,  n  >  1 }  be  constants  such  that  a  *  0,  b  >  0, 
n-'     'n-'  nn 

n  >_  1  . 

(i)  Suppose  that 


"   2      2 

Z  a.    =   o(b^)  (2) 

k  =  1  ^  " 


and  either 


^n 

(a)  c  t,  c  /n  +,  and  Z  (c./k)   =  0( — ^^— )  (3) 

n     n         k=1   ^         "2 

^  ^k 
k  =  1  ^ 


or 


"   2       2 
(6)   c  /n  1-  and  Z  a,  =  0(na  ).  (4) 

n        ,  ,  k      n 
k=1 


Then  if 


nP||x|  >  c^}  =  0(1)  (5) 


the  GWLLN 


53 


?a^(X^-EXI(|x|  <0)  p 

1-^ .0  (6) 

n 


obtains. 

(ii)   Conversely,  if  {x,  X  ,  n  >^  1  }  are  independent  random 

variables,  and  (a  ,  n  >  1  I  and  fb  ,  n  >  1  |  are  constants  with 
n    -       '  n    - 

0<b  +=>,  c  ■*  <"   and 
n      n 


a 

inf{|  — I  :  1  <  k  <  n,  n  >  1  }  >  0,  (7) 

a. 

n 


then  (6)  implies  (5). 

Proof,   (i)   Let  d  =  c  /n,  n  >  1  and  X,^"^  =  X,  I(  I X,  I  <  c  )  f  or 
n    n     -       k      k   I  k'  -  n 

n  n    ,  . 

1  <  k  <  n,  n  >  1.   Also  let  S  =  Z  a,  X,  ,  n  >  1  ,  and  S'  =  Z  a,  X,  \ 
--     -  n,,kk-        n,,kk 

k=1  k=l 

n  >   1 .      Then  for  arbitrary   e  >  0 


Is   -ES'I  IS'-ES'+S   -S'l 

plLn^  >   ^}    =  Pi"       ;     "     "     >   e} 
n  n 


I S' -ES'I  Is   -S'l 

<p|_rL_r^>|}    ,p|i_n_Jli>||.  (q) 

n  n 


Now 


n  k=1 
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n 
<  I  P{|X  I  >  c  }  =  nP||x|  >  c  }  =  0(1)     (by  (5)).       (9) 
k  =  1    '^     "  n 


Letting  c„  =  0  and  noting  that  c  +  under  either  case  (a)  or 
0  n 


(B),  it  follows  that 


IS'-ES'I 
n 


<^Var(ja^X^")) 

e  b     k=1 
n 


b  k  =  1 
n 


r   "  ?  ? 
<  ^  I   a^EX  I(|X|  <  c^) 

b'^  k  =  1  ^  " 

n 


r   "  ?  "   ? 
=  (^  E  an  E  EX  Kg,  .  <  |x|  <  c.) 

b"^  k=1  '^  j  =  1      ^'^  J 

n 


<  (^  Z  an  E  c^P{c.  ,  <  |X|  <  c.} 
n 


=  (^  E  a^)  E  C^[P{|X|  >  c   }  -  P||X|  >  c  }] 

b'^   k=1  ^  j  =  1  -^         J  ^  J 

n      "^ 
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(%  Z  a2)[c2p{|x|  >  0}  -  c^Pllxl  >  c  }  ^  "z  (c^  -c2)p{|x|  >  c.}] 

b'^  k=l  '^   ^  "        "    j=1  J^  J        J 

n  "* 


(by  Abel's  summation  by  parts  lemma) 


nn-1  n 

<  (^  Za^)  Z  (c^  -c2)Pi|x|  >  c  }  .  ^  Z  a^ 
b^  k  =  l  *"  j  =  i  J  '   J         J    b^  k=1  '^ 


,C_     "l   _2,":V,.,,,2.2      .2.2 


k=l    j  =  1        J        J         J 


b 
n 


C   "  2  "~V.2^2     ,.  2      .2.2- 


<  (^  Z  ap   Z  U  (i%^    -  3jd;   -  j''ci;]P{|x|  >  c  }  +  o(l 


b^  k  =  l     j  =  l 


(^  Z  a^)  Z  [j(d^  -d^)  +  3d^  ]JP{|X|  >  c.}  +  0(1 
b'^  k=1  "^0  =  1    J  1   J      J*'  J 


n 
C  Z  B   JP{|X|  >  c  }  +  o(1)  (10) 

j=o  "-J       J 


wher 


B  . 
nj 


(^  Z  a^)[j(d^  -d^)  +  3d^  ]      if  j  =  1....,n-1, 
b  k=1  "^     J  I   J      J  +  i 
n 


if  j  =  O.n. 
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It  will  now  be  shown  that  {b  .,  0  _<  j  _<  n,  n  >_  1  }  is  a  Toeplitz 


array,  that  is 


n 

I  JB  .1  =  0(1)  (11) 


and 


B  .  -»•  0   as  n  ^  "  for  all  fixed  j  >  0.  (12) 

nj  -^  - 


First  note  that 


"  2 
n 


>  (  ~  -  )t(o ■  ■ -c.)  >  0     (since  c.  +) 
n 


Clearly  (12)  prevails  by  (2).   In  case  (a)  we  note  that  d  +  and 

n 

n        2^2 

Z  d.  =  0(b  /  Z  a,  ),  whence 

n  2  "2 

,   Z  a,  Z  a, 

n         n      n-1     •<   o  u-i  '^  "  5 

^  |B,j|  =   Z  B   <   Z  (^)3dJ  <  3(^)  Z  dj 

j=0  "J    j=0  "J   j  =  l    b^    -^  b^  j  =  l  ^ 


=  0(1), 


whence  (11)  obtains. 
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On  the  other  hand,  under  case  (g),  we  have  d  t  and 

n 

"  2      2 

Z  a,  <  Cna  ,  n  >  1 .  Then  for  all  n  >  1 
k  -    n    -  — 


k=1 


"  2 

I   a7  2 

k=1  ^       _n  ^   Cn  _   Cn   ^  _C_ 

2-2     2        2     2' 

b      b     c    (nd  )    nd 
n     n     n     n      n 


Then 


I  Ib  .1  =   IB. 
j=o'  "j'   j=0  "J 


"  2 
1   I  a, 


=  i(-T-)t^(Vr^j)  ^3d.,^] 


J  =  ^    ^n 


c  "-^ 


nd  j=1    J  '  J      J  ' 
n  "^ 


C  ""^   2     ""^2     C  ""^  2 
=  -^(  I  jdj^^  -   E  jdj)  .  -^  E  d^,^ 

nd^  j  =  l   ^     j  =  1   ^    nd^  J  =  1  -^ 


C   "       2  ""^   2  C       2 

<  ^(  E  (j-l)d^  -  E  odf)  +  ^(n-l)d^     (since  d^  O 

nd"^  j=2      •J  j=2  -^  nd 

n  n 


C   "   2   "'^   2 
<  ^(  E  jd':  -   E  jdf)  +  0(1) 

nd^  j=2  J   j=2  J 
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^  (nd^)  +  0(1)  =  0(1) 


^2   n 
nd 
n 

and  again  (11)  holds  thereby  proving  that  JB  .,  0  <_  j  <_  n,  n  >_  1  }  is 
a  Toeplitz  array. 

Then  by  (5)  and  the  Toeplitz  lemma  (see,  e.g.,  Knopp,  1951, 
p.  74) 


n 

I  B  .JP{|X|  >  c.}  =  0(1).  (13) 


Retracing  our  steps  we  see  that  (10)  and  (13)  ensure  that 

|S'-ES' I 
p{ — ^ — —   >  |}  =  o(1)  which  together  with  (8)  and  (9)  imply  that 
n 

S  -ES'  P 

— r ■*  0   thereby  proving  (6). 

n 

a 
(ii)   Define  5  =  inf||  — |  :  1  <  k  <  n,  n  >  l}.   Therefore  for 

3. 

n 

all  n  >_  1  and  1  <_  k  <_  n,  |a  |  >^  6|a  |  or,  equivalently , 

K       n 


<  -| r     for  1  <  k  <  n,  n  >  1.  (14) 


'  k'    '  n 


Set 


n 


D  =   E  a,  EXK  Ixl  <  0  ),  n  >  1  , 
n   ,  .  k    '  '  -  n     - 

K  =  1 
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n 

S  =  I  a,  X,  ,  n  >  1 , 
n   ,^1  k  k    - 


d  =  D  -D  , ,  n  >  2, 
n    n  n-1    - 


Thus,  for  n  >  2 


|a  X  -d  I    |(S  -S   )  -  (D  -D   ) 
'  n  n  n'    '   n  n-1      n  n-1 


b  b 

n  n 


S  -D    b   ,    S   -D   , 
n  n    n-1    n-1   n-1 


b      b       b  , 
n      n       n-1 


Is  -D  I  Is   -D  J 

.  '  n  n'  '  n-1   n-1  '       ,  .    ^   , 

<  r +  r (since  b  +) 

~    b„  b^  .                 n 

n  n-1 


P 

^  0  (by  (6)). 


a  X   d  P 

Then  since  X  =  X,  we  have  -z r^  ->  0.  The  hypothesis 

n  b    b 

a^X  P    "    " 

c„  *  "  ensures  that  r —  ■*   0  which  then  implies  that  d  /b  =  o(1). 
n  b  ^         n  n 

n 

For  arbitrary  e  >  0,  by  Levy's  inequality  (letting  m(Y)  denote  a 
median  of  a  random  variable  Y) , 


P(  max  I  (S,  -D,  )  -  m(S,  -D,  -S  +D  )  I  >  eb  } 
1<l«n   ^  '^      k  k  n  n  I 
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<  2P{|S^-D^|    >   eb    }   =  0(1)  (by   (6)), 


Hence 


max    l(S,  -D,  )    -  m(S,  -D,  -S  +D   )| 
,^,  ^'kk  kknn' 

I £k<n  P 

^ 

b 
n 


0.  (15) 


Next,  it  follows  from  (6)  and  Exercise  3.3.7  of  Chow  and  Teicher 
(1978,  p.  73)  that 


max     m(S,  -D  -S  +D   )      =   o(b   ).  (16) 

, ,,  .    '        kknn'  n 

1  <k<n 


Therefore 


max    |S  -D    I 
1<k<n 

b 
n 


max    |(S,  -D,  )    -  m(S,  -D,  -S  +D   ) 
...  ^'kk  kknn 

Kk<^n 

_ 

n 


max     m(S,  -D,  -S  +D   ) 
.,.,  k     k     n     n   ' 

1 <K<n  P 


b 
n 


^  0  (by   (151    and   (16)).  (17) 
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We  now  show  that 


max  Id,  I  =  o(b  ).  (18) 

1  <k<n 


Recalling  that  d  =  o(b  )  and  b  +,  we  obtain  for  all  m  <  n 
n      n      n 


max  |d  I    max  |d  |    max  |d  j 
1<l<<n       l<k<m      m<k<n 


< 


b      -    b  b 

n         n         n 


max  |d|^| 

1  <k<m  d,  n-»"     d,   m^™ 

I  k I        I  ki     ^ 

^ ^  max  |— I  — >  sup|  — I  — >  0 

n     m<k<n  k      k>m  k 


thereby  proving  (18). 

Recalling  (7),  note  that  6  >  0.   Then  realizing  that 


P(  max  |a  X  -d  I  <  hh   ] 
1<k<n  ^  ^     ^         ^  " 


>  P{  max  |S  -D  I  <  |b  } , 
l<k<n  ^     '^         ^  " 


we  conclude,  via  (17),  that 


lim  P{  max  I  a,  X,  -d,  I  <  ^6b  }  =  1  .  (19) 

,  ^,  ^  '  k  k  k'  -  3  n' 
n-*"   1<k<n 


Using  (18),  we  have  for  sufficiently  large  n 
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P{   max    ia  X  -d    I    <  fsb    ] 


<  P{   max    |a  X    I    <   6b   } 
l<l«n     ^  ^  " 


PlnUa^Xj    <6b^]} 


n 

=   n  P{|X|  <  6b  /|a  II 
k=1         "  ^ 


<     n  P{|X|  <  b  /|a  11  (by  (U)) 


k=1        "   " 


(P{|X|  <  cj)"  =  (1  -  P{|X|  >  cj)". 


Recalling  (19)  we  obtain 


lim  (1  -  P{|X|  >  c  })"  =  1  . 


n^oo 


—3 
Using  the  basic  inequality  1 -s  <  e   ,  we  see  that 


(1  -  P{|X|  >  c^})"  <  exp(-nP{|x|  >  c^}}  <  1 
and  thus  (5)  follows.  D 
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The  hypotheses  of  Theorem  4.1  do  not  seem  to  be  directly 

comparable  to  the  hypotheses  of  the  strong  law  theorems.   The 

condition  {'i)   does  resemble  the  previous  condition 

n 

Z  |a  I  =  0(n|a  |),  but  there  are  in  fact  other  similarities. 
k  =  1  ^  " 

Fact.   If  X  is  any  random  variable  and  {c  ,  n  >  1 |  is  a  nondecreasing 


sequence  of  constants  satisfying  E  P{|x|  >  c  }  <  ",  then  (5) 

n=l        " 

follows. 


Proof.   Since  c  +  we  have  pIIxI  >  c  I  +.   This  combined  with 
n  ' '  '    n' 

00 

E  P(|X|  >  c  }  <  "  implies  via  Knopp  (1951,  p.  124)  that 
n=1        " 

nP{|x|  >  c  1  =  0(1).  D 

An  example  (Example  4.2)  will  be  given  in  Section  4.3  showing 
that  we  can  obtain  via  Theorem  4.1  a  GWLLN.   The  example  fails  to 
satisfy  the  hypotheses  of  the  GSLLN  of  Theorem  3.5.   In  fact,  we  show 
that  the  GSLLN  actually  fails.   Before  we  present  our  examples,  a  few 
immediate  corollaries  of  Theorem  4.1  will  be  established. 

Corollary  4.1  (Klass  and  Teicher,  1977).   Let  {x,  X  ,  n  >  1 }  be 

i.i.d.  random  variables  and  let  lb  ,  n  >  1 1  be  constants  such  that 

'  n    - 


0  <  b  +  and  either 
n 


-         "      ?      ? 

(i)   b  /n  +,  b  //n  ^  "^,  and  E  (b, /k)   =  0(b  /n) 

n      n  ,  1   •<         n 

k=l 


or 


(ii)   b  /n  t, 
n 


Then 


n 

Z  X,  -nEXK  Ixl  <  b  )  „ 
k  =  1  '^      '  '  -  n  P 

■* 

h 
n 


iff 
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0  (20) 


nPi|x|  >  b  }  =  0(1).  (21) 


Proof.   Assume  that  (21  )  holds.   Now  letting  a  =  1 ,  we  note  that  in 

2 

either  case  (i)  or  (ii)  we  have  b  /n  *  *  which  is  tantamount  to 

n 

(2).   Finally,  note  that  (3)  trivially  holds  under  case  (i)  and  that 

(4)  trivially  holds  under  case  (ii).   Hence  we  can  conclude  (20)  in 

either  case  directly  from  Theorem  4.1(i). 

Conversely,  under  (20)  if  we  again  let  a  =  1 ,  we  see  that  (7) 

n 

is  immediate,  whence  (21)  follows  from  Theorem  4.1(ii).Q 
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Corollary  4.2  (Classical  WLLN,  Chow  and  Teicher,  1978,  p.  125).   Let 
{x,  X  ,  n  >^  1  }  be  i.i.d.  random  variables.   Then 


n 

E  X  -nEXK  |X|  <  n) 
k=1 


iff 


nP{|x|  >  n}  =  o(l) 


Proof.   By  letting  b  =  n,  n  >_  1  ,  the  corollary  follows  immediately 
from  Corollary  4.1  by  either  case  (i)  or  (ii).  D 

Finally,  we  end  this  section  with  a  corollary  that  removes  the 
indicator  functions  from  (6). 

Corollary  4.3.   Let  {x,  X  ,  n  >_  1  }  be  i.i.d.  ^     random  variables. 

Let  fa  ,  n  >  1  1  and  lb  ,  n  >  1  I  be  constants  such  that  a^  *   0, 
'  n    -         n    -  n 

b  >  0,  n  >  1,   Z  a,  =  o(b  ),  and  nP(|x|  >  c  }  =  o(l).   Suppose  that 
n       -    ,  ,  k      n         '  '    n' 
k=1 

either  2 

"      2      ^n 

(i)  c  +,  c  /n  +,  and  Z  (c, /k)   =  0(— ) 

n  •   n    •     k=1   ''         "2 

k  =  1  ^ 
or 

"   2       2 
(ii)   c  /n  t  and  Z  a,  =  0(na  ) . 

k=1  ^ 

n 

^  \ 
k=1 
If  lim  — r —  =  M  exists  and  is  finite,  then 
b 
n->-<"    n 
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'^ ^   MEX. 

D 

n 


Proof.      Note  that  all   the  hypotheses  of  Theorem  ^.1(i)    are 
satisfied.      Observe  that 


n 

E  a,  EXKlxl    <   c   ) 

liLJ ^ MEXl 

n 


n 

I  a,  EXKlxl    <   c    ) 
k  —     n 

\— MEXKlxl    <    c    )|    +    ImEXKIxI    <    c    )    -   MEXl 

n 


n 

^  \ 
EXI(|X|    <    c^)||^^   -   M|    +    |M||EXI(|X|    <    c^)    -   EX| 
n 


n 

^  \ 
<   E|x||i^  -   M|    *    |M|E|X1I(IX|    >    c^) 
n 


Now  the  first  term  is  o(1)   by  definition  of  M  and  the  fact   that 
X  e  jL'      If  c     +   ",    the  second  term  is  also  o(1)   by  the  Lebesgue 
dominated  convergence  theorem  since  X  e  X.-,'      Suppose  '^^i  ^   ^o  '^  °°* 
If   c     =   c     for   all   large  n,    then  the  hypothesis   nP{|x|    >   c    }    =   o(1) 
ensures   that   p{|x|    >   c    }    =  0   and  hence  for   all  large  n, 

e|x|I(|x|    >   c   )    =   ElxlKlxl    >   c   )    =   0.      If   c      <   c      for   all   large   n, 
iiii  ^  iiii  Q  no 

then  the  hypothesis   nP{|x|    >   c    |    =  o(l)    ensures  that 
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P{|X|  >  c^}  ^  P{|X|  >  c^}  =  0 


implying 


|x|l(|x|  >  c  )  +  |x|l(|x|  >  c  )  =  0   a.s. 


Then  since  X  g  ^  ,  by  the  Lebesgue  dominated  convergence  theorem 
E|X|I(|X|  >  c  )  =  o(1).   Then  applying  Theorem  H.], 


n 

I  a,  X, 

^^\ MEX 

b 
n 


I  a,  (X,  -EXKlxl    <  c   ))  E  a,  EXKlxl    <  c    ) 

kk     ''-n     u-^    ^  ''-n       P 

!LJ ^ +  !<d ^ MEX  ^  O.D 

b  b 

n  n 


^.3  Some  Interesting  Examples 
We  conclude  this  chapter  with  three  examples.   The  first  will 
establish  a  GWLLN  for  a  weighted  sum  of  i.i.d.  random  variables  whose 
common  density  function  is  defined  as  in  Example  2.2.   The  second 
will  be  an  example  that  establishes  a  GWLLN  while  showing  that  the 
GSLLN  fails.   The  final  example  solves  the  Petersburg  paradox  in  the 
"classical"  or  "weak"  sense  for  a  class  of  weighted  i.i.d.  random 
variables. 
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In  Example  2.2  we  have  seen  that  if  {x  ,  n  _>  1 }  are  i.i.d.  with 
common  density  function 


e~,2(log  Ixl )-l,  .11 

— ( ^  'g'  — )  for  |x|  >  e, 


X 


f(x) 


for  |x|  <  e, 


n 


^  a,  X,  ^ 

then  -^— ^  N(0,1)  if  0  <  b  t  <»  and  c    =  b  / 1  a  I  =  %/nlog  n. 

b  n         n      n  '  n'    2 

n 

Z  a,  X, 

Then,  in  Example  3.^^,  we  showed  via  Theorem  3.5  that  ^^— ^ ->  0  a.s. 

b 
n 

if  0  <  b^  t  "  and  c    =  b  /la  I  =  n^  ^L(n)  +  for  some  0  <  p  <  2  and 
n         n      n  '  n'  ^ 

positive  slowly  varying  function  L.   Therefore,  in  trying  to  find  an 

example  of  |a^,  n  >  l},  |b  ,  n  >  l}  obeying  (1),  there  are  a  few 

constraints  that  must  be  imposed  on  the  sequence 

ic'^^  -  b  /|a  I,  n  >  l}. 
^  n      n  '  n'    -  ' 

Suppose  that  {a  ,  n  >_  1  }  and  {b  ,  n  >  1  }  are  such  that 
0  <  b^  t  0.  and  c^-^  =  /nexp{/log  n|,  n  >_  1.   A  GWLLN  will  be 
established  in  the  ensuing  Example  4.1.   It  is  interesting  to  compare 
c^   with  the  c^   and  c    of  Examples  2.2  and  3-4,  respectively. 

For  note  that  these  {c,  n>l},  1<i<3,  satisfy  c    =  o(c^^^) 

and  c^3)  ^  ^(^(2) 
n       n 

Before  presenting  Example  4.1,  let  us  observe  that  Theorem  3.4 
is  not  applicable  if  c  =  /nexp{/log  n},  n  >_  1 .   To  see  this  note  for 
n  sufficiently  large  that 
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1       2  _  1     2/log  n  „      T 

-  max  c,  Z  — p  =  e         I ZZZZZ 

1<k<n  i=n  c.  j=n  .  2/log  j 

-  -  J  je 


^  2/log  n  r      1    ^ 

>^  e       J  dx  ■*   " 

n   2/log  X 
xe 


(by  Theorem  1(a)  of  Feller,  1971,  p.  281) 


and  hence  (5)  (with  q  =  2)  fails.  We  are  unable  to  determine  whether 

n 

or  not  the  GSLLN  Z  a,  X, /b  -»■  0  a.s.  holds.   The  work  of  Rosalsky 
,  ,  k  k  n 
k=1 

(1981)  on  generalized  laws  of  the  iterated  logarithm  might  shed  some 

light  on  this  problem,  but  this  would  require  some  discussion. 

In  the  following  example  the  weights  are  geometrically  growing. 


Example  4.1.   Let  {x,  X  ,  n  >_  1  }  be  i.i.d.  random  variables  with 
common  density  function 


e!(2(lo£_l|iM)        if  |x|  >  e, 
Ixl 


f(x) 


if  X  <  e. 


Then  for  every  a  >  1 


'<=^       .   0.  (22) 


r-   n  /log  n 
/na  e 
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b     /-  n  /log  n      /T 

Proof.   Firstly,  note  that  c  -   -i r  =  =  /ne 

•'  n    a         n 

'  n'        a 

and  that  EXKixl  <  c  )  =  0,  n  >  1  .   We  will  verify  that  the 
'  '  —  n        — 

conditions  (2),  (3),  and  (5)  of  Theorem  4.1(i)(a)  obtain.   Clearly 

0  '^  and  c  /n  -^  eventually.   Since  a  >  1 
n       n 

;  2    "2k   a^^^^^^-a^  ,,    2n, 
Z  a  =  I  a   = =  0(a   ) 

1<=1     k=1        a  -1 


and  so 


;  2 

,^^k  2n  . 

lill   =  o( §-_— )  =  o( )  =  o(1 

b         2n  2/log  n        2/log  n 
n      na  e    ^       ne    ° 


This  also  shows  that 


^'^l^S  n  __  ^^^2^  [     2)_  (23; 


"  k  =  1  "" 


Next,  for  n  sufficiently  large 


n  c  2    n  2/log  k 

^  ( V  =  ^  ^-k 

k=l  ^    k=l 


n 


^^2/logn    1 
k  =  r 


^  ^2/log  nr"^V. 


/   Idx 
1  ^ 
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2/log  n.   ,   , > 
e    *  log(n+1) 


b^ 


=  0(ne   ^  )  =  0(-^^^)      (recalling  (23)) 

1     2 

1<  =  1  ^ 


Finally,  we  need  to  show  that  (5)  obtains.   Recall  from  Example  2.2 
that  P{|x|  >  x}  =  (-)  log  X,  X  >  e.   Hence 


2 

nP{|x|  >  c^}  =  ^log  c^ 

c 
n 


ne    ,   /  /-  /log  n, 
log(/ne   °     , 


2/log  n 
ne 


e^  ,1 


(-log  n  +  /log  n)  =  o(1 ) 


2/log  n 

The  conclusion  (22)  now  follows  directly  from  Theorem  i^.l.  D 

The  next  example,  which  generalizes  a  classical  example,  will 

n 

show  that  the  GSLLN  Z  a,  X, /b  -*  0  a.s.  can  fail  while  establishing 

,=T  k  k  n 

the  GWLLN  (1).   Both  of  these  assertions  will  be  substantiated  in  the 
example. 


Example  4.2.   Let  (x,  X  ,  n  >_  1  }  be  i.i.d.  random  variables  with 
common  density  function 


f(x)  = 
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Y-^ 5  if|x|>e. 

X  (log  |x| ) 

0  if  Ixl  <  e, 


where  0  <  6  <  1  and  C.  is  an  appropriate  constant.   Then  for  any 
—         0 

sequence  {a  ,  n  >  1  }  with  0  <  |a^|  t,  we  have 


but 


}\\   P 

^ r-   ^  0  (24) 

n  a 
'  n' 


P{lim^^4^p  =  0}  =  0.  (25) 


Proof.  We  will  prove  (24)  by  applying  Theorem  4.1(i)(S)  with 

b  =  nla  I,  n  >  1.   Note  that  c  =b/|a|=n,  n>l,  and 
n    '  n'    -  n    n  '  n'       - 

EXI(|x|  <  n)  =0,  n  >  1.  Hence  we  need  to  verify  (2),  (4),  and  (5) 

Clearly  c  /n  +  and  since  0  <  la  I  +, 
n  '  n' 


I  a^  <  na^  =  o(b^) 
k  =  1 


and  so  (2)  and  (4)  hold.   To  show  that  (5)  also  holds,  note  that  for 
n  sufficiently  large 


nP{|x|  >  c^}  =  nP{|x|  >  nj 
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=  2ncJ 


n  X  (log  x) 


dx 


2C. 


(1+0(1))- 


(log  n) 


(by  Theorem  1(a)  of 
Feller,  1971  ,  p.  281) 


(26) 


=  0(1) 


(since  6  >  0). 


The  conclusion  (24)  follows  from  Theorem  4.1 


I  ^  K\\ 


We  will  now  show  that  lim  sup 


k=1 


k  k' 


nl  a 

1  r 


"  a.s.  which  of  course 


implies  (25).   Clearly  c  /n  +  and  b  =  0(b  ^  )  since  b  =  n|a^| 


Thus,  for  n  sufficiently  large 


Z  P{|X|  >  c J  =  Z  P{|X|  >  n} 


n=1 


n=1 


>   Z 


:dx 


n=n   Ix'  >n  x  (log  Ixl ) 


17^ 


00       00 

2C.   Z   /  — — ^ rdx 

n=n  n  x  (log  x) 
o 


>  C^  I       ^ 7         (by  (26)) 

n=n  n(log  n) 
o 


=  00  (since  6  _<  1 ) 

whence,  via  Lemma  3.8,  lim  sup  —  i   i —  =  "  a.s.  and  (25) 

n^oo      I  n' 

follows.  D 

Remark.   By  letting  6  =1  and  a  =  1  we  obtain  the  classical  example 
of  the  WLLN  holding  but  the  SLLN  failing. 

We  conclude  with  a  generalization  of  the  Petersburg  game.   As 
discussed  previously,  the  Petersburg  game  involved  trying  to  find  a 

n 

sequence  (m  ,  n  >  1  }  such  that  I   a  X  /m  -»■  1  in  some  sense.   The 
n  .  _  ^  K  K  n 

paradox  occurs  when  the  random  variables  are  not  integrable.  We  have 
already  shown  in  Corollary  3.11  that  there  is  not  a  solution  to  this 
game  in  the  "strong"  sense  provided  that  the  {a  ,  n  >  1 }  satisfy 
certain  mild  conditions.  We  will  show  via  an  example  of  a  particular 
distribution  that  there  indeed  can  be  a  solution  to  the  game  in  the 
"classical"  or  "weak"  sense. 
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The  original  Petersburg  game  concerned  tossing  a  fair  coin.   In 
this  game  a  player  would  receive  2^  dollars  if  heads  appears  for  the 
first  time  on  the  j^*^  toss.   Thus  the  random  variables  of  interest 
are  geometric,  i.e.,  p{x  =  Z'^}  =2"^,  j  2l  ^  •   ^°te  that  even  though 
EX  =  ",  most  people  would  not  pay  any  large  fixed  amount  of  money  to 
play  since  the  probability  of  winning  a  large  amount  of  money  is 
small. 


Example  ^.3.   Let  {x,  X  ,  n  >  1  }  be  i.i.d.  random  variables  with 


P{X  =  2-^}  =2''^,  j  >  1  .   Then 


n 

Z  k^'x 
k=1   ^  P  1      .     .   1 


for  a  >   -  -k  (27) 


a+1,       ci+1     ^-  -  '   2 
n   Log  n 


(where  Log  n  denotes  the  logarithm  to  the  base  2)  but 


n 

I  \<\ 

P(lim  ^ =  1}  =  0  (28) 

'       m 
n->-"     n 


for  every  a  >  -1  and  sequence  {m  ,  n  _>  1 


Proof.   Firstly,  we  will  show  that 


P(|X|  >  x}  <  2/x,     X  >  2.  (29; 


If  2"  <  X  <  2"""^  where  n  >  1  ,  then 
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P{|X|  >  x}  <  P{X  >  2"}  =  1  -  P{X  <  2"} 


which  is  tantamount  to  (29) . 

Let  b  =  n   Log  n,  n  >  1  ,  and  a  =  n  ,  n  >  1 ,  where 

a  >  -  1/2.   Clearly  b  >  0  and  c  /n  =  Log  n  t.   Also  note  that 
•'   n         n 

n  ^    n 

Z  a^  =  Z  k    =  0(n    )  (since  a  >  -1/2)  and  since 
k  =  l  "^   k=1 

na  =  n  "   we  observe  that  Z  af  =  0(na  ).   Also  note  that  since 

k  =  1  ^ 

Jl  2a+2,,     ,2     ,     "2    ,^2, 

b  =  n    (Log  n)  ,  we  have  Z  a  =  o(b  ). 

"  k=l  "      " 

So  in  view  of  Theorem  4.1(i)(S),  for  a  GWLLN  to  hold,  we  only 
need  to  verify  (5).   Now,  recalling  (29), 


nP(|x|  >  c  1  =  nPi|x|  >  nLog  n} 


<-r^^=o(1) 
-  nLog  n 


whence,  via  Theorem  ^A, 


n 

Z  k°'(X|^-EXI(|x|  <  nLog  n))  p 

^^ ^  0.  (30) 

a+1, 
n   Log  n 


Next,  observe  that 
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a   .  _  . 

EXI(  Ixl  <  c  )  =   E  2'^2  •^  =  a 


where  a  is  the  largest  integer  such  that  2  _<  c  =  nLog  n,  whence 

a+ 1 
nLog  n  <  2    and  (letting  [b]  denote  the  greatest  integer  in  b) 


a  =  [LogCnLog  n)]  ~  Log  n  +  Log  Log  n  -  Log  n. 


Thus 


EXI(|X]  <  0  )  -  Log  n.  (31) 


Also  observe  that 


n 
k=1  n"^' 


a+1  ,    ^,  s    a+1        a+1 

n  (a+1 )n 


Therefore 


n 

EkX 
k=1        ^  1 


a+1  a+1 

n       Log  n 


n  n 

I   k°'(X,  -EXI(|X|    <    c    ))  E   k°'EXI(|x|    <    c    ) 

k=1  ^   k=1  1 


a+1,  a+1,  a+1 

n       Log  n  n       Log  n 


(32) 
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n 

I   k^CXj^-EXK  |X|  <  c^)) 

— : +  0(1)     (by  (31)  and  (32)) 

a+1 , 
n   Log  n 


P 

^  0         (by  (30)) 


thereby  proving  (27) 


a 


To  prove  (28),  we  invoke  Corollary  3.11  with  a  =  n  ,  n  >_  1  , 
where  a  >  -1 .   We  have  already  observed  that  E|x|  =  «>  and  hence  we 

n 

need  only  verify  that  I    |a|  =  0(n|a  |)  and  n|a  |  t.   Clearly 

k=l 

nla    I    =  n"       t  since  a  >   -1 .      Also  since  a  >    -1 
'    n' 


E    |aj    =      I  k"  =  0(n''^^    =  0(n|a   |) 
k=1      ^         k=1  " 


thereby  proving  (28).  Q 

Remark.   If  we  let  a  =  0  in  Example  4.3,  we  obtain  the  classical 

Petersburg  game.   Note  what  we  have  demonstrated  here.  We  have 

presented  a  game  in  which  there  is  not  any  normalization  {m  ,  n  >^  1 

n 
for  which  E  k^X,  /m  -»■  1  a.s.  (that  is,  the  convergence  to  1  is  in 
k=1   "^  " 

the  "strong"  sense).   On  the  other  hand,  we  have  shown  that  the 
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a+1 

sequence  b  = ?^  "  does  indeed  normalize  (to  1)  the  sum 

^      n      a+1 

n 

Z   k^X  in  the  "classical"  or  "weak"  sense,  that  is 

k=1   "^ 


n 
(a+1)  I  k\   p 
k=1 


a+1, 
n   Log  n 
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